You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Andrija Panic <an...@gmail.com> on 2015/02/25 13:09:59 UTC
Uploading of Volume - how does what here ?
Hi guys,
I'm just uploading a Volume, and I guess it will end up on the CEPH storage
that we are using.
So my qyestion would be: VOLUME will end up on the primary storage in the
end, but right now, I can see that the SSVM is actuall y downloading the
Volume from internet, and writing it to Secondary Storage at the moment.
WHat happens next - I know that both SSVM and ofcoure my NFS server, can
not write/talk at all to CEPH ?
Does maybe some randomly choosen host, mounts Secondary Storage NFS, read
Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
actually talk to CEPH)
Thanks in advance for clarification...
--
Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Nux! <nu...@li.nux.ro>.
Andrija,
I think this is one of those cases where we can verify it empirically. :-)
Start a volume upload and keep an eye on "ps", "top", "iotop", "df"/"mount" etc on the hypervisors.
HTH
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
----- Original Message -----
> From: "Andrija Panic" <an...@gmail.com>
> To: users@cloudstack.apache.org
> Cc: dev@cloudstack.apache.org
> Sent: Thursday, 26 February, 2015 09:05:01
> Subject: Re: Uploading of Volume - how does what here ?
> Thx Lucian,
>
> that was my guessing, but would like some confirmation if anyone familiar
> with this...
>
> Thanks
>
> On 25 February 2015 at 17:57, Nux! <nu...@li.nux.ro> wrote:
>
>> Not a CEPH user, but what I believe happens is your HV mounts the NFS
>> storage and then does something like "qemu-img convert" to move it into
>> CEPH.
>>
>> HTH
>> Lucian
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
>>
>> ----- Original Message -----
>> > From: "Andrija Panic" <an...@gmail.com>
>> > To: dev@cloudstack.apache.org, users@cloudstack.apache.org
>> > Sent: Wednesday, 25 February, 2015 12:09:59
>> > Subject: Uploading of Volume - how does what here ?
>>
>> > Hi guys,
>> >
>> > I'm just uploading a Volume, and I guess it will end up on the CEPH
>> storage
>> > that we are using.
>> >
>> > So my qyestion would be: VOLUME will end up on the primary storage in the
>> > end, but right now, I can see that the SSVM is actuall y downloading the
>> > Volume from internet, and writing it to Secondary Storage at the moment.
>> >
>> > WHat happens next - I know that both SSVM and ofcoure my NFS server, can
>> > not write/talk at all to CEPH ?
>> >
>> > Does maybe some randomly choosen host, mounts Secondary Storage NFS, read
>> > Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
>> > actually talk to CEPH)
>> >
>> > Thanks in advance for clarification...
>> >
>> > --
>> >
>> > Andrija Panić
>>
>
>
>
> --
>
> Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Andrija Panic <an...@gmail.com>.
Now you see, that is 5 star answer :)
Thank you very much Marcus
@Nux, will confirm what Marcus said, as you proposed with top and ther
stuff - I just wanted confirmation/info, that I got from Marcus.
On 26 February 2015 at 10:26, Marcus <sh...@gmail.com> wrote:
> The volume is downloaded by the SSVM into secondary storage under the
> volumes directory. It will sit there until you choose to attach it
> somewhere, at which point a CopyCommand will be sent to a hypervisor
> that has access to the primary storage for the cluster on which the
> target VM is running to copy from secondary to primary. This will be
> handled by the appropriate StorageAdaptor for the primary storage type
> (most likely LibvirtStorageAdaptor, which will qemu-img it, converting
> to RAW format for RBD/LVM, or just a plain cp last I checked for QCOW2
> to QCOW2).Then an AttachCommand will be sent to the hypervisor on
> which the target vm is running (if it is running) and it will be
> hotplugged.
>
> On Thu, Feb 26, 2015 at 1:05 AM, Andrija Panic <an...@gmail.com>
> wrote:
> > Thx Lucian,
> >
> > that was my guessing, but would like some confirmation if anyone familiar
> > with this...
> >
> > Thanks
> >
> > On 25 February 2015 at 17:57, Nux! <nu...@li.nux.ro> wrote:
> >
> >> Not a CEPH user, but what I believe happens is your HV mounts the NFS
> >> storage and then does something like "qemu-img convert" to move it into
> >> CEPH.
> >>
> >> HTH
> >> Lucian
> >>
> >> --
> >> Sent from the Delta quadrant using Borg technology!
> >>
> >> Nux!
> >> www.nux.ro
> >>
> >> ----- Original Message -----
> >> > From: "Andrija Panic" <an...@gmail.com>
> >> > To: dev@cloudstack.apache.org, users@cloudstack.apache.org
> >> > Sent: Wednesday, 25 February, 2015 12:09:59
> >> > Subject: Uploading of Volume - how does what here ?
> >>
> >> > Hi guys,
> >> >
> >> > I'm just uploading a Volume, and I guess it will end up on the CEPH
> >> storage
> >> > that we are using.
> >> >
> >> > So my qyestion would be: VOLUME will end up on the primary storage in
> the
> >> > end, but right now, I can see that the SSVM is actuall y downloading
> the
> >> > Volume from internet, and writing it to Secondary Storage at the
> moment.
> >> >
> >> > WHat happens next - I know that both SSVM and ofcoure my NFS server,
> can
> >> > not write/talk at all to CEPH ?
> >> >
> >> > Does maybe some randomly choosen host, mounts Secondary Storage NFS,
> read
> >> > Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
> >> > actually talk to CEPH)
> >> >
> >> > Thanks in advance for clarification...
> >> >
> >> > --
> >> >
> >> > Andrija Panić
> >>
> >
> >
> >
> > --
> >
> > Andrija Panić
>
--
Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Andrija Panic <an...@gmail.com>.
Now you see, that is 5 star answer :)
Thank you very much Marcus
@Nux, will confirm what Marcus said, as you proposed with top and ther
stuff - I just wanted confirmation/info, that I got from Marcus.
On 26 February 2015 at 10:26, Marcus <sh...@gmail.com> wrote:
> The volume is downloaded by the SSVM into secondary storage under the
> volumes directory. It will sit there until you choose to attach it
> somewhere, at which point a CopyCommand will be sent to a hypervisor
> that has access to the primary storage for the cluster on which the
> target VM is running to copy from secondary to primary. This will be
> handled by the appropriate StorageAdaptor for the primary storage type
> (most likely LibvirtStorageAdaptor, which will qemu-img it, converting
> to RAW format for RBD/LVM, or just a plain cp last I checked for QCOW2
> to QCOW2).Then an AttachCommand will be sent to the hypervisor on
> which the target vm is running (if it is running) and it will be
> hotplugged.
>
> On Thu, Feb 26, 2015 at 1:05 AM, Andrija Panic <an...@gmail.com>
> wrote:
> > Thx Lucian,
> >
> > that was my guessing, but would like some confirmation if anyone familiar
> > with this...
> >
> > Thanks
> >
> > On 25 February 2015 at 17:57, Nux! <nu...@li.nux.ro> wrote:
> >
> >> Not a CEPH user, but what I believe happens is your HV mounts the NFS
> >> storage and then does something like "qemu-img convert" to move it into
> >> CEPH.
> >>
> >> HTH
> >> Lucian
> >>
> >> --
> >> Sent from the Delta quadrant using Borg technology!
> >>
> >> Nux!
> >> www.nux.ro
> >>
> >> ----- Original Message -----
> >> > From: "Andrija Panic" <an...@gmail.com>
> >> > To: dev@cloudstack.apache.org, users@cloudstack.apache.org
> >> > Sent: Wednesday, 25 February, 2015 12:09:59
> >> > Subject: Uploading of Volume - how does what here ?
> >>
> >> > Hi guys,
> >> >
> >> > I'm just uploading a Volume, and I guess it will end up on the CEPH
> >> storage
> >> > that we are using.
> >> >
> >> > So my qyestion would be: VOLUME will end up on the primary storage in
> the
> >> > end, but right now, I can see that the SSVM is actuall y downloading
> the
> >> > Volume from internet, and writing it to Secondary Storage at the
> moment.
> >> >
> >> > WHat happens next - I know that both SSVM and ofcoure my NFS server,
> can
> >> > not write/talk at all to CEPH ?
> >> >
> >> > Does maybe some randomly choosen host, mounts Secondary Storage NFS,
> read
> >> > Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
> >> > actually talk to CEPH)
> >> >
> >> > Thanks in advance for clarification...
> >> >
> >> > --
> >> >
> >> > Andrija Panić
> >>
> >
> >
> >
> > --
> >
> > Andrija Panić
>
--
Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Marcus <sh...@gmail.com>.
The volume is downloaded by the SSVM into secondary storage under the
volumes directory. It will sit there until you choose to attach it
somewhere, at which point a CopyCommand will be sent to a hypervisor
that has access to the primary storage for the cluster on which the
target VM is running to copy from secondary to primary. This will be
handled by the appropriate StorageAdaptor for the primary storage type
(most likely LibvirtStorageAdaptor, which will qemu-img it, converting
to RAW format for RBD/LVM, or just a plain cp last I checked for QCOW2
to QCOW2).Then an AttachCommand will be sent to the hypervisor on
which the target vm is running (if it is running) and it will be
hotplugged.
On Thu, Feb 26, 2015 at 1:05 AM, Andrija Panic <an...@gmail.com> wrote:
> Thx Lucian,
>
> that was my guessing, but would like some confirmation if anyone familiar
> with this...
>
> Thanks
>
> On 25 February 2015 at 17:57, Nux! <nu...@li.nux.ro> wrote:
>
>> Not a CEPH user, but what I believe happens is your HV mounts the NFS
>> storage and then does something like "qemu-img convert" to move it into
>> CEPH.
>>
>> HTH
>> Lucian
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
>>
>> ----- Original Message -----
>> > From: "Andrija Panic" <an...@gmail.com>
>> > To: dev@cloudstack.apache.org, users@cloudstack.apache.org
>> > Sent: Wednesday, 25 February, 2015 12:09:59
>> > Subject: Uploading of Volume - how does what here ?
>>
>> > Hi guys,
>> >
>> > I'm just uploading a Volume, and I guess it will end up on the CEPH
>> storage
>> > that we are using.
>> >
>> > So my qyestion would be: VOLUME will end up on the primary storage in the
>> > end, but right now, I can see that the SSVM is actuall y downloading the
>> > Volume from internet, and writing it to Secondary Storage at the moment.
>> >
>> > WHat happens next - I know that both SSVM and ofcoure my NFS server, can
>> > not write/talk at all to CEPH ?
>> >
>> > Does maybe some randomly choosen host, mounts Secondary Storage NFS, read
>> > Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
>> > actually talk to CEPH)
>> >
>> > Thanks in advance for clarification...
>> >
>> > --
>> >
>> > Andrija Panić
>>
>
>
>
> --
>
> Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Marcus <sh...@gmail.com>.
The volume is downloaded by the SSVM into secondary storage under the
volumes directory. It will sit there until you choose to attach it
somewhere, at which point a CopyCommand will be sent to a hypervisor
that has access to the primary storage for the cluster on which the
target VM is running to copy from secondary to primary. This will be
handled by the appropriate StorageAdaptor for the primary storage type
(most likely LibvirtStorageAdaptor, which will qemu-img it, converting
to RAW format for RBD/LVM, or just a plain cp last I checked for QCOW2
to QCOW2).Then an AttachCommand will be sent to the hypervisor on
which the target vm is running (if it is running) and it will be
hotplugged.
On Thu, Feb 26, 2015 at 1:05 AM, Andrija Panic <an...@gmail.com> wrote:
> Thx Lucian,
>
> that was my guessing, but would like some confirmation if anyone familiar
> with this...
>
> Thanks
>
> On 25 February 2015 at 17:57, Nux! <nu...@li.nux.ro> wrote:
>
>> Not a CEPH user, but what I believe happens is your HV mounts the NFS
>> storage and then does something like "qemu-img convert" to move it into
>> CEPH.
>>
>> HTH
>> Lucian
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
>>
>> ----- Original Message -----
>> > From: "Andrija Panic" <an...@gmail.com>
>> > To: dev@cloudstack.apache.org, users@cloudstack.apache.org
>> > Sent: Wednesday, 25 February, 2015 12:09:59
>> > Subject: Uploading of Volume - how does what here ?
>>
>> > Hi guys,
>> >
>> > I'm just uploading a Volume, and I guess it will end up on the CEPH
>> storage
>> > that we are using.
>> >
>> > So my qyestion would be: VOLUME will end up on the primary storage in the
>> > end, but right now, I can see that the SSVM is actuall y downloading the
>> > Volume from internet, and writing it to Secondary Storage at the moment.
>> >
>> > WHat happens next - I know that both SSVM and ofcoure my NFS server, can
>> > not write/talk at all to CEPH ?
>> >
>> > Does maybe some randomly choosen host, mounts Secondary Storage NFS, read
>> > Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
>> > actually talk to CEPH)
>> >
>> > Thanks in advance for clarification...
>> >
>> > --
>> >
>> > Andrija Panić
>>
>
>
>
> --
>
> Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Nux! <nu...@li.nux.ro>.
Andrija,
I think this is one of those cases where we can verify it empirically. :-)
Start a volume upload and keep an eye on "ps", "top", "iotop", "df"/"mount" etc on the hypervisors.
HTH
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
----- Original Message -----
> From: "Andrija Panic" <an...@gmail.com>
> To: users@cloudstack.apache.org
> Cc: dev@cloudstack.apache.org
> Sent: Thursday, 26 February, 2015 09:05:01
> Subject: Re: Uploading of Volume - how does what here ?
> Thx Lucian,
>
> that was my guessing, but would like some confirmation if anyone familiar
> with this...
>
> Thanks
>
> On 25 February 2015 at 17:57, Nux! <nu...@li.nux.ro> wrote:
>
>> Not a CEPH user, but what I believe happens is your HV mounts the NFS
>> storage and then does something like "qemu-img convert" to move it into
>> CEPH.
>>
>> HTH
>> Lucian
>>
>> --
>> Sent from the Delta quadrant using Borg technology!
>>
>> Nux!
>> www.nux.ro
>>
>> ----- Original Message -----
>> > From: "Andrija Panic" <an...@gmail.com>
>> > To: dev@cloudstack.apache.org, users@cloudstack.apache.org
>> > Sent: Wednesday, 25 February, 2015 12:09:59
>> > Subject: Uploading of Volume - how does what here ?
>>
>> > Hi guys,
>> >
>> > I'm just uploading a Volume, and I guess it will end up on the CEPH
>> storage
>> > that we are using.
>> >
>> > So my qyestion would be: VOLUME will end up on the primary storage in the
>> > end, but right now, I can see that the SSVM is actuall y downloading the
>> > Volume from internet, and writing it to Secondary Storage at the moment.
>> >
>> > WHat happens next - I know that both SSVM and ofcoure my NFS server, can
>> > not write/talk at all to CEPH ?
>> >
>> > Does maybe some randomly choosen host, mounts Secondary Storage NFS, read
>> > Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
>> > actually talk to CEPH)
>> >
>> > Thanks in advance for clarification...
>> >
>> > --
>> >
>> > Andrija Panić
>>
>
>
>
> --
>
> Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Andrija Panic <an...@gmail.com>.
Thx Lucian,
that was my guessing, but would like some confirmation if anyone familiar
with this...
Thanks
On 25 February 2015 at 17:57, Nux! <nu...@li.nux.ro> wrote:
> Not a CEPH user, but what I believe happens is your HV mounts the NFS
> storage and then does something like "qemu-img convert" to move it into
> CEPH.
>
> HTH
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
> ----- Original Message -----
> > From: "Andrija Panic" <an...@gmail.com>
> > To: dev@cloudstack.apache.org, users@cloudstack.apache.org
> > Sent: Wednesday, 25 February, 2015 12:09:59
> > Subject: Uploading of Volume - how does what here ?
>
> > Hi guys,
> >
> > I'm just uploading a Volume, and I guess it will end up on the CEPH
> storage
> > that we are using.
> >
> > So my qyestion would be: VOLUME will end up on the primary storage in the
> > end, but right now, I can see that the SSVM is actuall y downloading the
> > Volume from internet, and writing it to Secondary Storage at the moment.
> >
> > WHat happens next - I know that both SSVM and ofcoure my NFS server, can
> > not write/talk at all to CEPH ?
> >
> > Does maybe some randomly choosen host, mounts Secondary Storage NFS, read
> > Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
> > actually talk to CEPH)
> >
> > Thanks in advance for clarification...
> >
> > --
> >
> > Andrija Panić
>
--
Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Andrija Panic <an...@gmail.com>.
Thx Lucian,
that was my guessing, but would like some confirmation if anyone familiar
with this...
Thanks
On 25 February 2015 at 17:57, Nux! <nu...@li.nux.ro> wrote:
> Not a CEPH user, but what I believe happens is your HV mounts the NFS
> storage and then does something like "qemu-img convert" to move it into
> CEPH.
>
> HTH
> Lucian
>
> --
> Sent from the Delta quadrant using Borg technology!
>
> Nux!
> www.nux.ro
>
> ----- Original Message -----
> > From: "Andrija Panic" <an...@gmail.com>
> > To: dev@cloudstack.apache.org, users@cloudstack.apache.org
> > Sent: Wednesday, 25 February, 2015 12:09:59
> > Subject: Uploading of Volume - how does what here ?
>
> > Hi guys,
> >
> > I'm just uploading a Volume, and I guess it will end up on the CEPH
> storage
> > that we are using.
> >
> > So my qyestion would be: VOLUME will end up on the primary storage in the
> > end, but right now, I can see that the SSVM is actuall y downloading the
> > Volume from internet, and writing it to Secondary Storage at the moment.
> >
> > WHat happens next - I know that both SSVM and ofcoure my NFS server, can
> > not write/talk at all to CEPH ?
> >
> > Does maybe some randomly choosen host, mounts Secondary Storage NFS, read
> > Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
> > actually talk to CEPH)
> >
> > Thanks in advance for clarification...
> >
> > --
> >
> > Andrija Panić
>
--
Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Nux! <nu...@li.nux.ro>.
Not a CEPH user, but what I believe happens is your HV mounts the NFS storage and then does something like "qemu-img convert" to move it into CEPH.
HTH
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
----- Original Message -----
> From: "Andrija Panic" <an...@gmail.com>
> To: dev@cloudstack.apache.org, users@cloudstack.apache.org
> Sent: Wednesday, 25 February, 2015 12:09:59
> Subject: Uploading of Volume - how does what here ?
> Hi guys,
>
> I'm just uploading a Volume, and I guess it will end up on the CEPH storage
> that we are using.
>
> So my qyestion would be: VOLUME will end up on the primary storage in the
> end, but right now, I can see that the SSVM is actuall y downloading the
> Volume from internet, and writing it to Secondary Storage at the moment.
>
> WHat happens next - I know that both SSVM and ofcoure my NFS server, can
> not write/talk at all to CEPH ?
>
> Does maybe some randomly choosen host, mounts Secondary Storage NFS, read
> Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
> actually talk to CEPH)
>
> Thanks in advance for clarification...
>
> --
>
> Andrija Panić
Re: Uploading of Volume - how does what here ?
Posted by Nux! <nu...@li.nux.ro>.
Not a CEPH user, but what I believe happens is your HV mounts the NFS storage and then does something like "qemu-img convert" to move it into CEPH.
HTH
Lucian
--
Sent from the Delta quadrant using Borg technology!
Nux!
www.nux.ro
----- Original Message -----
> From: "Andrija Panic" <an...@gmail.com>
> To: dev@cloudstack.apache.org, users@cloudstack.apache.org
> Sent: Wednesday, 25 February, 2015 12:09:59
> Subject: Uploading of Volume - how does what here ?
> Hi guys,
>
> I'm just uploading a Volume, and I guess it will end up on the CEPH storage
> that we are using.
>
> So my qyestion would be: VOLUME will end up on the primary storage in the
> end, but right now, I can see that the SSVM is actuall y downloading the
> Volume from internet, and writing it to Secondary Storage at the moment.
>
> WHat happens next - I know that both SSVM and ofcoure my NFS server, can
> not write/talk at all to CEPH ?
>
> Does maybe some randomly choosen host, mounts Secondary Storage NFS, read
> Volume, and upload/write to CEPH ? (Since only hypervisor hosts can
> actually talk to CEPH)
>
> Thanks in advance for clarification...
>
> --
>
> Andrija Panić