You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Damien Mannix <da...@unimelb.edu.au> on 2013/11/05 06:44:24 UTC
NFS vs Swift
HI All,
We are currently running CloudStack 3.07 with NFS Secondary Storage which we have had continuing issues with. Has anyone migrated from NFS to swift? Pros / Cons – any tips would be most helpful.
Thanks in advance
Damien
Damien Mannix
Cloud Systems Administrator
ITS Research Services
317 Doug McDonell Building, University of Melbourne
email: damien.mannix@unimelb.edu.au
NSP Support please email: nsp-help@nectar.org.au
Mobile: +61 (0) 481 005 367
Re: NFS vs Swift
Posted by sebgoa <ru...@gmail.com>.
On Nov 5, 2013, at 9:08 AM, Damien Mannix <da...@unimelb.edu.au> wrote:
> Hi Sebastian,
>
> Yes we are using the commercial version, we are also using XenServer 6.1
> for the underlying hypervisor and there seems to be problems with NFS /
> CloudPlatform, not confirmed. Just trying to work out reasonable options
> to make life easier. We have no control over the storage as such as it is
> centrally provisioned by the Universities IT department with very little
> transparency. The actual storage is in a datacentre next door 3 x hops -
> but I'm finding it difficult to troubleshoot as it is all very
> inconsistent.
Technically we don't support non apache releases, but maybe if you post your mgt server logs and your secondary storage VM logs to pastebin.com something easy will jump out for someone on the list.
-sebastien
>
> Thanks for your input.
>
> Damien
>
> On 5/11/13 6:51 PM, "Sebastien Goasguen" <ru...@gmail.com> wrote:
>
>>
>> On Nov 5, 2013, at 12:44 AM, Damien Mannix <da...@unimelb.edu.au>
>> wrote:
>>
>>> HI All,
>>>
>>> We are currently running CloudStack 3.07 with NFS Secondary Storage
>>> which we have had continuing issues with. Has anyone migrated from NFS
>>> to swift? Pros / Cons any tips would be most helpful.
>>>
>>> Thanks in advance
>>>
>>> Damien
>>
>> Damien, 3.07 is not an official apache cloudstack release, you might be
>> referring to a cloudplatform commercial version ?
>>
>> I would recommend to upgrade to 4.1.1 or 4.2.0
>>
>> In 4.2 there is much better support for S3 backed secondary storage
>> including Ceph radoggw, RiakCS and glusterfs. Basically any S3 object
>> store can be used.
>>
>> That said having issues with NFS seems strange, I would personally first
>> try to solve the NFS issues send us some logs if you want.
>>
>>>
>>>
>>> Damien Mannix
>>> Cloud Systems Administrator
>>> ITS Research Services
>>> 317 Doug McDonell Building, University of Melbourne
>>> email: damien.mannix@unimelb.edu.au
>>> NSP Support please email: nsp-help@nectar.org.au
>>> Mobile: +61 (0) 481 005 367
>>>
>>>
>>>
>>
>>
>
>
Re: NFS vs Swift
Posted by Damien Mannix <da...@unimelb.edu.au>.
Hi Sebastian,
Yes we are using the commercial version, we are also using XenServer 6.1
for the underlying hypervisor and there seems to be problems with NFS /
CloudPlatform, not confirmed. Just trying to work out reasonable options
to make life easier. We have no control over the storage as such as it is
centrally provisioned by the Universities IT department with very little
transparency. The actual storage is in a datacentre next door 3 x hops -
but I'm finding it difficult to troubleshoot as it is all very
inconsistent.
Thanks for your input.
Damien
On 5/11/13 6:51 PM, "Sebastien Goasguen" <ru...@gmail.com> wrote:
>
>On Nov 5, 2013, at 12:44 AM, Damien Mannix <da...@unimelb.edu.au>
>wrote:
>
>> HI All,
>>
>> We are currently running CloudStack 3.07 with NFS Secondary Storage
>>which we have had continuing issues with. Has anyone migrated from NFS
>>to swift? Pros / Cons any tips would be most helpful.
>>
>> Thanks in advance
>>
>> Damien
>
>Damien, 3.07 is not an official apache cloudstack release, you might be
>referring to a cloudplatform commercial version ?
>
>I would recommend to upgrade to 4.1.1 or 4.2.0
>
>In 4.2 there is much better support for S3 backed secondary storage
>including Ceph radoggw, RiakCS and glusterfs. Basically any S3 object
>store can be used.
>
>That said having issues with NFS seems strange, I would personally first
>try to solve the NFS issues send us some logs if you want.
>
>>
>>
>> Damien Mannix
>> Cloud Systems Administrator
>> ITS Research Services
>> 317 Doug McDonell Building, University of Melbourne
>> email: damien.mannix@unimelb.edu.au
>> NSP Support please email: nsp-help@nectar.org.au
>> Mobile: +61 (0) 481 005 367
>>
>>
>>
>
>
Re: NFS vs Swift
Posted by Sebastien Goasguen <ru...@gmail.com>.
On Nov 5, 2013, at 12:44 AM, Damien Mannix <da...@unimelb.edu.au> wrote:
> HI All,
>
> We are currently running CloudStack 3.07 with NFS Secondary Storage which we have had continuing issues with. Has anyone migrated from NFS to swift? Pros / Cons – any tips would be most helpful.
>
> Thanks in advance
>
> Damien
Damien, 3.07 is not an official apache cloudstack release, you might be referring to a cloudplatform commercial version ?
I would recommend to upgrade to 4.1.1 or 4.2.0
In 4.2 there is much better support for S3 backed secondary storage including Ceph radoggw, RiakCS and glusterfs. Basically any S3 object store can be used.
That said having issues with NFS seems strange, I would personally first try to solve the NFS issues send us some logs if you want.
>
>
> Damien Mannix
> Cloud Systems Administrator
> ITS Research Services
> 317 Doug McDonell Building, University of Melbourne
> email: damien.mannix@unimelb.edu.au
> NSP Support please email: nsp-help@nectar.org.au
> Mobile: +61 (0) 481 005 367
>
>
>
Re: NFS vs Swift
Posted by Nux! <nu...@li.nux.ro>.
On 05.11.2013 09:06, Damien Mannix wrote:
> Yes I have heard of glusterfs any tips, tricks - advice?
Well, this is hardly the place, you should get on their ml, this is my
first advice.
Use CentOS/RHEL 6 if you can, use XFS as filesystem with 512b inodes.
If you want speed you need 10G or Infiniband, otherwise you'll have to
put up with sub 50 MB/s speeds on a mere 1Gbps network.
HTH
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
Re: NFS vs Swift
Posted by Damien Mannix <da...@unimelb.edu.au>.
Yes I have heard of glusterfs any tips, tricks - advice?
On 5/11/13 8:03 PM, "Nux!" <nu...@li.nux.ro> wrote:
>On 05.11.2013 05:44, Damien Mannix wrote:
>> HI All,
>>
>> We are currently running CloudStack 3.07 with NFS Secondary Storage
>> which we have had continuing issues with. Has anyone migrated from NFS
>> to swift? Pros / Cons any tips would be most helpful.
>>
>> Thanks in advance
>
>The main problem I have with NFS is scalability, it will hold back the
>whole setup when it gets real big.
>Luckily there are workarounds without messing with swift or other s3
>clones, one could use glusterfs' nfs interface + RR dns (we do this
>currently - though not for ACS - and it works well).
>I'd love to see native glusterfs support for secondary storage.
>
>My 2 strips of gold-pressed latinum
>
>--
>Sent from the Delta quadrant using Borg technology!
>
>Nux!
>www.nux.ro
>
Re: NFS vs Swift
Posted by Nux! <nu...@li.nux.ro>.
On 05.11.2013 05:44, Damien Mannix wrote:
> HI All,
>
> We are currently running CloudStack 3.07 with NFS Secondary Storage
> which we have had continuing issues with. Has anyone migrated from NFS
> to swift? Pros / Cons – any tips would be most helpful.
>
> Thanks in advance
The main problem I have with NFS is scalability, it will hold back the
whole setup when it gets real big.
Luckily there are workarounds without messing with swift or other s3
clones, one could use glusterfs' nfs interface + RR dns (we do this
currently - though not for ACS - and it works well).
I'd love to see native glusterfs support for secondary storage.
My 2 strips of gold-pressed latinum
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro