You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Pierre-Luc Dion <pd...@cloudops.com> on 2013/10/03 21:51:54 UTC
Create Template on NFS secondary Storage
Hi all,
We are currently using Cloudstack 4.1.0 managing XenServer 6.0.2 servers.
Since recently, I don't know what cause this to appear on our system but
went we create a template from a Instance the template (.vhd) is upload on
on the secondary storage (NFS) but in a subdirectory ex:
from the Storage VM:
/mnt/SecStorage/7f6f1f2d-2d6f-3ec6-a25e-fb25f2704167/template/tmpl/3/246
root@s-184-VM:~# ls -l
total 8
drwxr-xr-x 2 4294967294 4294967294 4096 Oct 3 19:35
02ee28f2-0c02-f936-3ca3-099cfe3f3a20
-rw-rw-rw- 1 4294967294 4294967294 314 Oct 3 19:36 template.properties
root@s-184-VM:~# ls 02ee28f2-0c02-f936-3ca3-099cfe3f3a20/
fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhd
So, when we create a new Instance from the template, the Instance creation
fail with the following error in the management-server.log:
2013-10-03 15:48:01,190 WARN [xen.resource.CitrixResourceBase]
(DirectAgent-255:null) Catch Exception
com.cloud.utils.exception.CloudRuntimeException on
host:9a02ac57-bc92-43af-b50a-f5ba2d0fd806 for template: nfs://
172.24.1.120/data/secondary/template/tmpl/3/246/fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhddue
to com.cloud.utils.exception.CloudRuntimeException: can not create vdi
in sr 451078ee-d335-bdb0-c41c-cd86524be3ea
if I move the VHD file in the 246 folder, it works !
Does anyone have this problem too or have an idea of where it would come
from ?
Thanks !
Pierre-Luc Dion
Responsable technique - infrastructure | Technical lead - infrastructure
- - -*
CloudOps
*www.cloudops.com
@CloudOps_
Re: Create Template on NFS secondary Storage
Posted by Pierre-Luc Dion <pd...@cloudops.com>.
Hi Kirk and Travis,
Thanks for your fast answer and reply. The problem was the one Kirk
mention, NFFSSR.py have been replace by an hotfix, we recently apply a
xenserver hotfix and since then we had problem creating templates. Pretty
much in the same time we add a new zone so I wasn't sure which event cause
the issue which is why I did not say it in the first email.
doe anyone know if there is a doc reference of all scripts replace on
xenserver by cloudstack? if it is not the only script.
That said, the only doc I've found regarding updating hypervisors is
http://cloudstack.apache.org/docs/en-US/Apache_CloudStack/4.2.0/html/Admin_Guide/maintain-hypervisors-on-hosts.html
which contain an outdated link.
Thanks again !
Pierre-Luc Dion
Responsable technique - infrastructure | Technical lead - infrastructure
514-447-3456, 1101
- - -*
CloudOps
*420 rue Guy
Montréal QC H3J 1S6
www.cloudops.com
@CloudOps_
On Thu, Oct 3, 2013 at 4:15 PM, Kirk Kosinski <ki...@gmail.com>wrote:
> Did you patch the hosts recently? That is the likely cause. The
> patched NFSSR.py that CloudStack copies to XS hosts can be overwritten
> by some patches. Without the patched NFSSR.py, when secondary storage
> is mounted it reverts to the default XenServer behavior of including an
> extra directory named after the SR UUID.
>
> One solution is to copy the correct NFSSR.py manually from the
> management server to /opt/xensource/sm/NFSSR.py on every XS host. There
> will be several versions of the script in
> /usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/ on the
> management server, and you can check the MD5 checksums beforehand to
> confirm it is the problem.
>
> Another solution is to force CloudStack to setup the host again, which
> includes copying NFSSR.py. To do this, unmanage the cluster in
> Cloudstack, clear the "tags" parameter for every host in the cluster (xe
> host-list, xe host-param-clear uuid=<uuid> param-name=tags), re-manage
> the cluster, and wait a few minutes.
>
> Best regards,
> Kirk
>
> On 10/03/2013 12:51 PM, Pierre-Luc Dion wrote:
> > Hi all,
> >
> > We are currently using Cloudstack 4.1.0 managing XenServer 6.0.2 servers.
> >
> >
> > Since recently, I don't know what cause this to appear on our system but
> > went we create a template from a Instance the template (.vhd) is upload
> on
> > on the secondary storage (NFS) but in a subdirectory ex:
> >
> > from the Storage VM:
> > /mnt/SecStorage/7f6f1f2d-2d6f-3ec6-a25e-fb25f2704167/template/tmpl/3/246
> > root@s-184-VM:~# ls -l
> > total 8
> > drwxr-xr-x 2 4294967294 4294967294 4096 Oct 3 19:35
> > 02ee28f2-0c02-f936-3ca3-099cfe3f3a20
> > -rw-rw-rw- 1 4294967294 4294967294 314 Oct 3 19:36 template.properties
> >
> > root@s-184-VM:~# ls 02ee28f2-0c02-f936-3ca3-099cfe3f3a20/
> > fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhd
> >
> >
> > So, when we create a new Instance from the template, the Instance
> creation
> > fail with the following error in the management-server.log:
> >
> > 2013-10-03 15:48:01,190 WARN [xen.resource.CitrixResourceBase]
> > (DirectAgent-255:null) Catch Exception
> > com.cloud.utils.exception.CloudRuntimeException on
> > host:9a02ac57-bc92-43af-b50a-f5ba2d0fd806 for template: nfs://
> >
> 172.24.1.120/data/secondary/template/tmpl/3/246/fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhddue
> > to com.cloud.utils.exception.CloudRuntimeException: can not create vdi
> > in sr 451078ee-d335-bdb0-c41c-cd86524be3ea
> >
> > if I move the VHD file in the 246 folder, it works !
> >
> > Does anyone have this problem too or have an idea of where it would come
> > from ?
> >
> > Thanks !
> >
> >
> > Pierre-Luc Dion
> > Responsable technique - infrastructure | Technical lead - infrastructure
> > - - -*
> > CloudOps
> > *www.cloudops.com
> > @CloudOps_
> >
>
Re: Create Template on NFS secondary Storage
Posted by Kirk Kosinski <ki...@gmail.com>.
Did you patch the hosts recently? That is the likely cause. The
patched NFSSR.py that CloudStack copies to XS hosts can be overwritten
by some patches. Without the patched NFSSR.py, when secondary storage
is mounted it reverts to the default XenServer behavior of including an
extra directory named after the SR UUID.
One solution is to copy the correct NFSSR.py manually from the
management server to /opt/xensource/sm/NFSSR.py on every XS host. There
will be several versions of the script in
/usr/share/cloudstack-common/scripts/vm/hypervisor/xenserver/ on the
management server, and you can check the MD5 checksums beforehand to
confirm it is the problem.
Another solution is to force CloudStack to setup the host again, which
includes copying NFSSR.py. To do this, unmanage the cluster in
Cloudstack, clear the "tags" parameter for every host in the cluster (xe
host-list, xe host-param-clear uuid=<uuid> param-name=tags), re-manage
the cluster, and wait a few minutes.
Best regards,
Kirk
On 10/03/2013 12:51 PM, Pierre-Luc Dion wrote:
> Hi all,
>
> We are currently using Cloudstack 4.1.0 managing XenServer 6.0.2 servers.
>
>
> Since recently, I don't know what cause this to appear on our system but
> went we create a template from a Instance the template (.vhd) is upload on
> on the secondary storage (NFS) but in a subdirectory ex:
>
> from the Storage VM:
> /mnt/SecStorage/7f6f1f2d-2d6f-3ec6-a25e-fb25f2704167/template/tmpl/3/246
> root@s-184-VM:~# ls -l
> total 8
> drwxr-xr-x 2 4294967294 4294967294 4096 Oct 3 19:35
> 02ee28f2-0c02-f936-3ca3-099cfe3f3a20
> -rw-rw-rw- 1 4294967294 4294967294 314 Oct 3 19:36 template.properties
>
> root@s-184-VM:~# ls 02ee28f2-0c02-f936-3ca3-099cfe3f3a20/
> fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhd
>
>
> So, when we create a new Instance from the template, the Instance creation
> fail with the following error in the management-server.log:
>
> 2013-10-03 15:48:01,190 WARN [xen.resource.CitrixResourceBase]
> (DirectAgent-255:null) Catch Exception
> com.cloud.utils.exception.CloudRuntimeException on
> host:9a02ac57-bc92-43af-b50a-f5ba2d0fd806 for template: nfs://
> 172.24.1.120/data/secondary/template/tmpl/3/246/fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhddue
> to com.cloud.utils.exception.CloudRuntimeException: can not create vdi
> in sr 451078ee-d335-bdb0-c41c-cd86524be3ea
>
> if I move the VHD file in the 246 folder, it works !
>
> Does anyone have this problem too or have an idea of where it would come
> from ?
>
> Thanks !
>
>
> Pierre-Luc Dion
> Responsable technique - infrastructure | Technical lead - infrastructure
> - - -*
> CloudOps
> *www.cloudops.com
> @CloudOps_
>
Re: Create Template on NFS secondary Storage
Posted by Travis Graham <tg...@tgraham.us>.
Can you check the permissions on the actual folders, 244 and 246 and see if they differ or have different owners?
Travis
On Oct 3, 2013, at 4:06 PM, Pierre-Luc Dion <pd...@cloudops.com> wrote:
> root@s-184-VM:# ls -lh 244/*
> -rw-rw-rw- 1 4294967294 4294967294 309 Oct 3 18:01 244/template.properties
>
> 244/a8ecc932-eaab-88f4-0687-37fbf15aeae5:
> total 1.4G
> -rw-r--r-- 1 4294967294 4294967294 1.5G Oct 3 18:01
> 73e0632e-c856-44f4-8712-ae1daf0d79d2.vhd
>
>
>
> Pierre-Luc Dion
> Responsable technique - infrastructure | Technical lead - infrastructure
> 514-447-3456, 1101
> - - -*
> CloudOps
> *420 rue Guy
> Montréal QC H3J 1S6
> www.cloudops.com
> @CloudOps_
>
>
> On Thu, Oct 3, 2013 at 3:59 PM, Travis Graham <tg...@tgraham.us> wrote:
>
>> Can you check the permissions on the subdirectories?
>>
>> Travis
>>
>> On Oct 3, 2013, at 3:51 PM, Pierre-Luc Dion <pd...@cloudops.com> wrote:
>>
>>> Hi all,
>>>
>>> We are currently using Cloudstack 4.1.0 managing XenServer 6.0.2 servers.
>>>
>>>
>>> Since recently, I don't know what cause this to appear on our system but
>>> went we create a template from a Instance the template (.vhd) is upload
>> on
>>> on the secondary storage (NFS) but in a subdirectory ex:
>>>
>>> from the Storage VM:
>>> /mnt/SecStorage/7f6f1f2d-2d6f-3ec6-a25e-fb25f2704167/template/tmpl/3/246
>>> root@s-184-VM:~# ls -l
>>> total 8
>>> drwxr-xr-x 2 4294967294 4294967294 4096 Oct 3 19:35
>>> 02ee28f2-0c02-f936-3ca3-099cfe3f3a20
>>> -rw-rw-rw- 1 4294967294 4294967294 314 Oct 3 19:36 template.properties
>>>
>>> root@s-184-VM:~# ls 02ee28f2-0c02-f936-3ca3-099cfe3f3a20/
>>> fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhd
>>>
>>>
>>> So, when we create a new Instance from the template, the Instance
>> creation
>>> fail with the following error in the management-server.log:
>>>
>>> 2013-10-03 15:48:01,190 WARN [xen.resource.CitrixResourceBase]
>>> (DirectAgent-255:null) Catch Exception
>>> com.cloud.utils.exception.CloudRuntimeException on
>>> host:9a02ac57-bc92-43af-b50a-f5ba2d0fd806 for template: nfs://
>>>
>> 172.24.1.120/data/secondary/template/tmpl/3/246/fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhddue
>>> to com.cloud.utils.exception.CloudRuntimeException: can not create vdi
>>> in sr 451078ee-d335-bdb0-c41c-cd86524be3ea
>>>
>>> if I move the VHD file in the 246 folder, it works !
>>>
>>> Does anyone have this problem too or have an idea of where it would come
>>> from ?
>>>
>>> Thanks !
>>>
>>>
>>> Pierre-Luc Dion
>>> Responsable technique - infrastructure | Technical lead - infrastructure
>>> - - -*
>>> CloudOps
>>> *www.cloudops.com
>>> @CloudOps_
>>
>>
Re: Create Template on NFS secondary Storage
Posted by Pierre-Luc Dion <pd...@cloudops.com>.
root@s-184-VM:# ls -lh 244/*
-rw-rw-rw- 1 4294967294 4294967294 309 Oct 3 18:01 244/template.properties
244/a8ecc932-eaab-88f4-0687-37fbf15aeae5:
total 1.4G
-rw-r--r-- 1 4294967294 4294967294 1.5G Oct 3 18:01
73e0632e-c856-44f4-8712-ae1daf0d79d2.vhd
Pierre-Luc Dion
Responsable technique - infrastructure | Technical lead - infrastructure
514-447-3456, 1101
- - -*
CloudOps
*420 rue Guy
Montréal QC H3J 1S6
www.cloudops.com
@CloudOps_
On Thu, Oct 3, 2013 at 3:59 PM, Travis Graham <tg...@tgraham.us> wrote:
> Can you check the permissions on the subdirectories?
>
> Travis
>
> On Oct 3, 2013, at 3:51 PM, Pierre-Luc Dion <pd...@cloudops.com> wrote:
>
> > Hi all,
> >
> > We are currently using Cloudstack 4.1.0 managing XenServer 6.0.2 servers.
> >
> >
> > Since recently, I don't know what cause this to appear on our system but
> > went we create a template from a Instance the template (.vhd) is upload
> on
> > on the secondary storage (NFS) but in a subdirectory ex:
> >
> > from the Storage VM:
> > /mnt/SecStorage/7f6f1f2d-2d6f-3ec6-a25e-fb25f2704167/template/tmpl/3/246
> > root@s-184-VM:~# ls -l
> > total 8
> > drwxr-xr-x 2 4294967294 4294967294 4096 Oct 3 19:35
> > 02ee28f2-0c02-f936-3ca3-099cfe3f3a20
> > -rw-rw-rw- 1 4294967294 4294967294 314 Oct 3 19:36 template.properties
> >
> > root@s-184-VM:~# ls 02ee28f2-0c02-f936-3ca3-099cfe3f3a20/
> > fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhd
> >
> >
> > So, when we create a new Instance from the template, the Instance
> creation
> > fail with the following error in the management-server.log:
> >
> > 2013-10-03 15:48:01,190 WARN [xen.resource.CitrixResourceBase]
> > (DirectAgent-255:null) Catch Exception
> > com.cloud.utils.exception.CloudRuntimeException on
> > host:9a02ac57-bc92-43af-b50a-f5ba2d0fd806 for template: nfs://
> >
> 172.24.1.120/data/secondary/template/tmpl/3/246/fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhddue
> > to com.cloud.utils.exception.CloudRuntimeException: can not create vdi
> > in sr 451078ee-d335-bdb0-c41c-cd86524be3ea
> >
> > if I move the VHD file in the 246 folder, it works !
> >
> > Does anyone have this problem too or have an idea of where it would come
> > from ?
> >
> > Thanks !
> >
> >
> > Pierre-Luc Dion
> > Responsable technique - infrastructure | Technical lead - infrastructure
> > - - -*
> > CloudOps
> > *www.cloudops.com
> > @CloudOps_
>
>
Re: Create Template on NFS secondary Storage
Posted by Travis Graham <tg...@tgraham.us>.
Can you check the permissions on the subdirectories?
Travis
On Oct 3, 2013, at 3:51 PM, Pierre-Luc Dion <pd...@cloudops.com> wrote:
> Hi all,
>
> We are currently using Cloudstack 4.1.0 managing XenServer 6.0.2 servers.
>
>
> Since recently, I don't know what cause this to appear on our system but
> went we create a template from a Instance the template (.vhd) is upload on
> on the secondary storage (NFS) but in a subdirectory ex:
>
> from the Storage VM:
> /mnt/SecStorage/7f6f1f2d-2d6f-3ec6-a25e-fb25f2704167/template/tmpl/3/246
> root@s-184-VM:~# ls -l
> total 8
> drwxr-xr-x 2 4294967294 4294967294 4096 Oct 3 19:35
> 02ee28f2-0c02-f936-3ca3-099cfe3f3a20
> -rw-rw-rw- 1 4294967294 4294967294 314 Oct 3 19:36 template.properties
>
> root@s-184-VM:~# ls 02ee28f2-0c02-f936-3ca3-099cfe3f3a20/
> fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhd
>
>
> So, when we create a new Instance from the template, the Instance creation
> fail with the following error in the management-server.log:
>
> 2013-10-03 15:48:01,190 WARN [xen.resource.CitrixResourceBase]
> (DirectAgent-255:null) Catch Exception
> com.cloud.utils.exception.CloudRuntimeException on
> host:9a02ac57-bc92-43af-b50a-f5ba2d0fd806 for template: nfs://
> 172.24.1.120/data/secondary/template/tmpl/3/246/fe2fa941-3030-412d-8c35-b0e80a2e7e09.vhddue
> to com.cloud.utils.exception.CloudRuntimeException: can not create vdi
> in sr 451078ee-d335-bdb0-c41c-cd86524be3ea
>
> if I move the VHD file in the 246 folder, it works !
>
> Does anyone have this problem too or have an idea of where it would come
> from ?
>
> Thanks !
>
>
> Pierre-Luc Dion
> Responsable technique - infrastructure | Technical lead - infrastructure
> - - -*
> CloudOps
> *www.cloudops.com
> @CloudOps_