You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Nux! <nu...@li.nux.ro> on 2013/02/13 13:20:03 UTC
glusterfs as secondary storage
Hi guys,
Is there a way to have glusterfs used for secondary storage in a basic
zone?
So far I found 2 ways of doing it, but both look too much like hacks:
1. replace /bin/mount with a shell wrapper, smth like this
http://fpaste.org/Gu7R/ (tested, works, but uses NFS, not the native
client)
2. mount glusterfs locally somewhere then re-export that via NFS and
use 127.0.0.1:/blah as secondary (untested yet, but looks better than
first option)
Would be nice to be able to add secondary storage as a shared mount
point..
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
Re: glusterfs as secondary storage
Posted by Nux! <nu...@li.nux.ro>.
On 13.02.2013 14:57, David Nalley wrote:
> On Wed, Feb 13, 2013 at 9:55 AM, Nux! <nu...@li.nux.ro> wrote:
>> On 13.02.2013 13:18, David Nalley wrote:
>>>
>>>
>>> You could use the Swift support in Gluster and use the Swift
>>> Secondary
>>> Storage support in CloudStack.
>>>
>>> --David
>>
>>
>> That would complicate my setup even more, it would mean to install
>> openstack
>> or the swift frontend for gluster,though I'll note it down, cheers.
>>
>> Regarding my "hacks", which one would you say is "best", or least
>> bad? I'm
>> thinking that both ways will be inpractical for the secondary storage
>> VM,
>> no? As I would have to do the same tricks there, too.
>>
>>
>> Lucian
>>
>
> There's an NFS option in Gluster, why not just use that?
>
> --David
David,
I'd gladly use it, but the Glusterfs nfs server is tcp only and the
mount command needs a "-o mountproto=tcp" as per my initial email. And
setting up a simple NFS server is simply not scalable.
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
Re: glusterfs as secondary storage
Posted by David Nalley <da...@gnsa.us>.
On Wed, Feb 13, 2013 at 9:55 AM, Nux! <nu...@li.nux.ro> wrote:
> On 13.02.2013 13:18, David Nalley wrote:
>>
>>
>> You could use the Swift support in Gluster and use the Swift Secondary
>> Storage support in CloudStack.
>>
>> --David
>
>
> That would complicate my setup even more, it would mean to install openstack
> or the swift frontend for gluster,though I'll note it down, cheers.
>
> Regarding my "hacks", which one would you say is "best", or least bad? I'm
> thinking that both ways will be inpractical for the secondary storage VM,
> no? As I would have to do the same tricks there, too.
>
>
> Lucian
>
There's an NFS option in Gluster, why not just use that?
--David
Re: glusterfs as secondary storage
Posted by Nux! <nu...@li.nux.ro>.
On 13.02.2013 13:18, David Nalley wrote:
>
> You could use the Swift support in Gluster and use the Swift Secondary
> Storage support in CloudStack.
>
> --David
That would complicate my setup even more, it would mean to install
openstack or the swift frontend for gluster,though I'll note it down,
cheers.
Regarding my "hacks", which one would you say is "best", or least bad?
I'm thinking that both ways will be inpractical for the secondary
storage VM, no? As I would have to do the same tricks there, too.
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
Re: glusterfs as secondary storage
Posted by David Nalley <da...@gnsa.us>.
On Wed, Feb 13, 2013 at 7:20 AM, Nux! <nu...@li.nux.ro> wrote:
> Hi guys,
>
> Is there a way to have glusterfs used for secondary storage in a basic zone?
> So far I found 2 ways of doing it, but both look too much like hacks:
> 1. replace /bin/mount with a shell wrapper, smth like this
> http://fpaste.org/Gu7R/ (tested, works, but uses NFS, not the native client)
> 2. mount glusterfs locally somewhere then re-export that via NFS and use
> 127.0.0.1:/blah as secondary (untested yet, but looks better than first
> option)
>
> Would be nice to be able to add secondary storage as a shared mount point..
>
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
You could use the Swift support in Gluster and use the Swift Secondary
Storage support in CloudStack.
--David
Re: glusterfs as secondary storage
Posted by David Nalley <da...@gnsa.us>.
On Wed, Feb 13, 2013 at 2:54 PM, Chiradeep Vittal
<Ch...@citrix.com> wrote:
> I'd vote for #2. But do the hypervisors use native Gluster?
>
Some recent updates to qemu/libvirt should make the most recent
version of gluster directly consumable by KVM.
RE: glusterfs as secondary storage
Posted by Donal Lafferty <do...@citrix.com>.
I just wanted to point out one item that might cause confusion for anyone reading the mailing list archives.
> So the SSVM copies templates from secondary storage to primary, and
> copies snapshots from primary to secondary.
[DL]
AFAIK, transfer between secondary storage and primary storage is carried out by the hypervisor plugin and not the SSVM.
Look at where the PrimaryStorageDownloadCommand is implemented.
Re: glusterfs as secondary storage
Posted by David Nalley <da...@gnsa.us>.
On Wed, Feb 13, 2013 at 3:21 PM, Nux! <nu...@li.nux.ro> wrote:
> On 13.02.2013 19:54, Chiradeep Vittal wrote:
>>
>> I'd vote for #2. But do the hypervisors use native Gluster?
>
>
> Yes, the HV are CentOS 6.3, used this repo to install the native client on
> them:
> http://repos.fedorapeople.org/repos/kkeithle/glusterfs/epel-6/x86_64/
>
> What confuses me is the "secondary storage VM", what does this VM do
> exactly? Does it need to mount the NFS share, too? Because in this case
> telling it to use 127.0.0.1 would get tricky..
>
So the SSVM copies templates from secondary storage to primary, and
copies snapshots from primary to secondary.
In addition it ages out snapshots, and provides a download interface
for exportable templates as well as acquires templates and ISOs and
writes them to Secondary Storage.
Re: glusterfs as secondary storage
Posted by Nux! <nu...@li.nux.ro>.
On 13.02.2013 19:54, Chiradeep Vittal wrote:
> I'd vote for #2. But do the hypervisors use native Gluster?
Yes, the HV are CentOS 6.3, used this repo to install the native client
on them:
http://repos.fedorapeople.org/repos/kkeithle/glusterfs/epel-6/x86_64/
What confuses me is the "secondary storage VM", what does this VM do
exactly? Does it need to mount the NFS share, too? Because in this case
telling it to use 127.0.0.1 would get tricky..
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
Re: glusterfs as secondary storage
Posted by Chiradeep Vittal <Ch...@citrix.com>.
I'd vote for #2. But do the hypervisors use native Gluster?
On 2/13/13 4:20 AM, "Nux!" <nu...@li.nux.ro> wrote:
>Hi guys,
>
>Is there a way to have glusterfs used for secondary storage in a basic
>zone?
>So far I found 2 ways of doing it, but both look too much like hacks:
>1. replace /bin/mount with a shell wrapper, smth like this
>http://fpaste.org/Gu7R/ (tested, works, but uses NFS, not the native
>client)
>2. mount glusterfs locally somewhere then re-export that via NFS and
>use 127.0.0.1:/blah as secondary (untested yet, but looks better than
>first option)
>
>Would be nice to be able to add secondary storage as a shared mount
>point..
>
>Lucian
>
>--
>Sent from the Delta quadrant using Borg technology!
>
>Nux!
>www.nux.ro