You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cloudstack.apache.org by Glen Baars <gl...@onsitecomputers.com.au> on 2018/05/17 11:50:41 UTC

Ceph RBD issues in 4.11

Hello Dev,

I have recently upgraded our cloudstack environment to 4.11. Mostly all has been smooth. ( this environment is legacy from cloud.com days! )

There are some issues that I have run into:

1.Can't install any VMs from ISO ( I have seen this in the list previously but can't find a bug report for it ) If further reports or debug will help I can assist. It is easy to reproduce.
2.When a VM is created from a template, the RBD features are lost. More info below.

Example of VM volume from template: -

user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/feeb52ec-f111-4a0d-9785-23aadd7650a5

rbd image 'feeb52ec-f111-4a0d-9785-23aadd7650a5':
        size 150 GB in 38400 objects
        order 22 (4096 kB objects)
        block_name_prefix: rbd_data.142926a5ee64
        format: 2
        features: layering
        flags:
        create_timestamp: Fri Apr 27 12:46:21 2018
        parent: AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-52c9307e53b4@cloudstack-base-snap
        overlap: 150 GB

Note the features are not the same as the parent : -

user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-52c9307e53b4
rbd image 'd7dcd9e4-ed55-44ae-9a71-52c9307e53b4':
        size 150 GB in 38400 objects
        order 22 (4096 kB objects)
        block_name_prefix: rbd_data.141d274b0dc51
        format: 2
        features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
        flags:
        create_timestamp: Fri Apr 27 12:37:05 2018


If you manually clone the volume the expected features are retained. We are running the latest Ceph version, KVM hosts on Ubuntu 16.04 with the latest Luminous qemu-img.

Kind regards,
Glen Baars

This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately.

Re: Ceph RBD issues in 4.11

Posted by Simon Weller <sw...@ena.com.INVALID>.
Glen,


Can you open a  github issue here: https://github.com/apache/cloudstack/issues


Please include logs of the second issue and we'll take a look at it.


- Si


________________________________
From: Glen Baars <gl...@onsitecomputers.com.au>
Sent: Thursday, May 17, 2018 7:20 AM
To: dev@cloudstack.apache.org
Subject: Re: Ceph RBD issues in 4.11

Yes - thanks for that.

Do you have any info about the second issue?

Glen Baars

Sent from my Cyanogen phone

On 17 May 2018 8:14 PM, Rafael Weing?rtner <ra...@gmail.com> wrote:
This problem sounds like the one described here
https://github.com/apache/cloudstack/issues/2641.
It seems that it was already fixed and will go out in 4.11.1.0

On Thu, May 17, 2018 at 8:50 AM, Glen Baars <gl...@onsitecomputers.com.au>
wrote:

> Hello Dev,
>
> I have recently upgraded our cloudstack environment to 4.11. Mostly all
> has been smooth. ( this environment is legacy from cloud.com days! )
>
> There are some issues that I have run into:
>
> 1.Can't install any VMs from ISO ( I have seen this in the list previously
> but can't find a bug report for it ) If further reports or debug will help
> I can assist. It is easy to reproduce.
> 2.When a VM is created from a template, the RBD features are lost. More
> info below.
>
> Example of VM volume from template: -
>
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/
> feeb52ec-f111-4a0d-9785-23aadd7650a5
>
> rbd image 'feeb52ec-f111-4a0d-9785-23aadd7650a5':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.142926a5ee64
>         format: 2
>         features: layering
>         flags:
>         create_timestamp: Fri Apr 27 12:46:21 2018
>         parent: AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-
> 52c9307e53b4@cloudstack-base-snap
>         overlap: 150 GB
>
> Note the features are not the same as the parent : -
>
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/
> d7dcd9e4-ed55-44ae-9a71-52c9307e53b4
> rbd image 'd7dcd9e4-ed55-44ae-9a71-52c9307e53b4':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.141d274b0dc51
>         format: 2
>         features: layering, exclusive-lock, object-map, fast-diff,
> deep-flatten
>         flags:
>         create_timestamp: Fri Apr 27 12:37:05 2018
>
>
> If you manually clone the volume the expected features are retained. We
> are running the latest Ceph version, KVM hosts on Ubuntu 16.04 with the
> latest Luminous qemu-img.
>
> Kind regards,
> Glen Baars
>
> This e-mail is intended solely for the benefit of the addressee(s) and any
> other named recipient. It is confidential and may contain legally
> privileged or confidential information. If you are not the recipient, any
> use, distribution, disclosure or copying of this e-mail is prohibited. The
> confidentiality and legal privilege attached to this communication is not
> waived or lost by reason of the mistaken transmission or delivery to you.
> If you have received this e-mail in error, please notify us immediately.
>



--
Rafael Weing?rtner
This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately.

Re: Ceph RBD issues in 4.11

Posted by Glen Baars <gl...@onsitecomputers.com.au>.
Yes - thanks for that.

Do you have any info about the second issue?

Glen Baars

Sent from my Cyanogen phone

On 17 May 2018 8:14 PM, Rafael Weing?rtner <ra...@gmail.com> wrote:
This problem sounds like the one described here
https://github.com/apache/cloudstack/issues/2641.
It seems that it was already fixed and will go out in 4.11.1.0

On Thu, May 17, 2018 at 8:50 AM, Glen Baars <gl...@onsitecomputers.com.au>
wrote:

> Hello Dev,
>
> I have recently upgraded our cloudstack environment to 4.11. Mostly all
> has been smooth. ( this environment is legacy from cloud.com days! )
>
> There are some issues that I have run into:
>
> 1.Can't install any VMs from ISO ( I have seen this in the list previously
> but can't find a bug report for it ) If further reports or debug will help
> I can assist. It is easy to reproduce.
> 2.When a VM is created from a template, the RBD features are lost. More
> info below.
>
> Example of VM volume from template: -
>
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/
> feeb52ec-f111-4a0d-9785-23aadd7650a5
>
> rbd image 'feeb52ec-f111-4a0d-9785-23aadd7650a5':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.142926a5ee64
>         format: 2
>         features: layering
>         flags:
>         create_timestamp: Fri Apr 27 12:46:21 2018
>         parent: AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-
> 52c9307e53b4@cloudstack-base-snap
>         overlap: 150 GB
>
> Note the features are not the same as the parent : -
>
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/
> d7dcd9e4-ed55-44ae-9a71-52c9307e53b4
> rbd image 'd7dcd9e4-ed55-44ae-9a71-52c9307e53b4':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.141d274b0dc51
>         format: 2
>         features: layering, exclusive-lock, object-map, fast-diff,
> deep-flatten
>         flags:
>         create_timestamp: Fri Apr 27 12:37:05 2018
>
>
> If you manually clone the volume the expected features are retained. We
> are running the latest Ceph version, KVM hosts on Ubuntu 16.04 with the
> latest Luminous qemu-img.
>
> Kind regards,
> Glen Baars
>
> This e-mail is intended solely for the benefit of the addressee(s) and any
> other named recipient. It is confidential and may contain legally
> privileged or confidential information. If you are not the recipient, any
> use, distribution, disclosure or copying of this e-mail is prohibited. The
> confidentiality and legal privilege attached to this communication is not
> waived or lost by reason of the mistaken transmission or delivery to you.
> If you have received this e-mail in error, please notify us immediately.
>



--
Rafael Weing?rtner
This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately.

Re: Ceph RBD issues in 4.11

Posted by Rafael Weingärtner <ra...@gmail.com>.
This problem sounds like the one described here
https://github.com/apache/cloudstack/issues/2641.
It seems that it was already fixed and will go out in 4.11.1.0

On Thu, May 17, 2018 at 8:50 AM, Glen Baars <gl...@onsitecomputers.com.au>
wrote:

> Hello Dev,
>
> I have recently upgraded our cloudstack environment to 4.11. Mostly all
> has been smooth. ( this environment is legacy from cloud.com days! )
>
> There are some issues that I have run into:
>
> 1.Can't install any VMs from ISO ( I have seen this in the list previously
> but can't find a bug report for it ) If further reports or debug will help
> I can assist. It is easy to reproduce.
> 2.When a VM is created from a template, the RBD features are lost. More
> info below.
>
> Example of VM volume from template: -
>
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/
> feeb52ec-f111-4a0d-9785-23aadd7650a5
>
> rbd image 'feeb52ec-f111-4a0d-9785-23aadd7650a5':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.142926a5ee64
>         format: 2
>         features: layering
>         flags:
>         create_timestamp: Fri Apr 27 12:46:21 2018
>         parent: AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-
> 52c9307e53b4@cloudstack-base-snap
>         overlap: 150 GB
>
> Note the features are not the same as the parent : -
>
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/
> d7dcd9e4-ed55-44ae-9a71-52c9307e53b4
> rbd image 'd7dcd9e4-ed55-44ae-9a71-52c9307e53b4':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.141d274b0dc51
>         format: 2
>         features: layering, exclusive-lock, object-map, fast-diff,
> deep-flatten
>         flags:
>         create_timestamp: Fri Apr 27 12:37:05 2018
>
>
> If you manually clone the volume the expected features are retained. We
> are running the latest Ceph version, KVM hosts on Ubuntu 16.04 with the
> latest Luminous qemu-img.
>
> Kind regards,
> Glen Baars
>
> This e-mail is intended solely for the benefit of the addressee(s) and any
> other named recipient. It is confidential and may contain legally
> privileged or confidential information. If you are not the recipient, any
> use, distribution, disclosure or copying of this e-mail is prohibited. The
> confidentiality and legal privilege attached to this communication is not
> waived or lost by reason of the mistaken transmission or delivery to you.
> If you have received this e-mail in error, please notify us immediately.
>



-- 
Rafael Weingärtner

Re: Ceph RBD issues in 4.11

Posted by Wido den Hollander <wi...@widodh.nl>.

On 05/17/2018 04:32 PM, Glen Baars wrote:
> Hello Wido,
> 
> Thanks for the reply.
> 
> I used the RBD command line tool directly without specifying any features. It’s the default since Ceph Jewel.
> 
> The features that I require are for these use cases:
> 
> 1.Using 'rbd du' the get the real disk usage of a volume without fast-diff is very slow. We need to schedule this after hours on large images.
> 2.We are starting to use rbd mirroring across to our secondary DC and this requires exclusive-lock.
> 3.Deep flatten can not be turned on after image creation. I am not sure if I require this feature at this time.
> 

I see. Could you create a issue for this and assign it to me on Github?
I'll take a look at it later.

The way it works right now as is intended. You can try to patch this
locally on your system by building a JAR file with a patch in there.

Will try to get this into 4.12

Wido

> Kind regards,
> Glen Baars
> 
> -----Original Message-----
> From: Wido den Hollander <wi...@widodh.nl>
> Sent: Thursday, 17 May 2018 10:18 PM
> To: dev@cloudstack.apache.org; Glen Baars <gl...@onsitecomputers.com.au>
> Subject: Re: Ceph RBD issues in 4.11
> 
> 
> 
> On 05/17/2018 01:50 PM, Glen Baars wrote:
>> Hello Dev,
>>
>> I have recently upgraded our cloudstack environment to 4.11. Mostly
>> all has been smooth. ( this environment is legacy from cloud.com days!
>> )
>>
>> There are some issues that I have run into:
>>
>> 1.Can't install any VMs from ISO ( I have seen this in the list previously but can't find a bug report for it ) If further reports or debug will help I can assist. It is easy to reproduce.
>> 2.When a VM is created from a template, the RBD features are lost. More info below.
>>
>> Example of VM volume from template: -
>>
>> user@NAS-AUBUN-RK3-CEPH01:~# rbd info
>> AUBUN-KVM-CLUSTER01-SSD/feeb52ec-f111-4a0d-9785-23aadd7650a5
>>
>> rbd image 'feeb52ec-f111-4a0d-9785-23aadd7650a5':
>>         size 150 GB in 38400 objects
>>         order 22 (4096 kB objects)
>>         block_name_prefix: rbd_data.142926a5ee64
>>         format: 2
>>         features: layering
>>         flags:
>>         create_timestamp: Fri Apr 27 12:46:21 2018
>>         parent: AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-52c9307e53b4@cloudstack-base-snap
>>         overlap: 150 GB
>>
>> Note the features are not the same as the parent : -
>>
>> user@NAS-AUBUN-RK3-CEPH01:~# rbd info
>> AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-52c9307e53b4
>> rbd image 'd7dcd9e4-ed55-44ae-9a71-52c9307e53b4':
>>         size 150 GB in 38400 objects
>>         order 22 (4096 kB objects)
>>         block_name_prefix: rbd_data.141d274b0dc51
>>         format: 2
>>         features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
>>         flags:
>>         create_timestamp: Fri Apr 27 12:37:05 2018
>>
>>
>> If you manually clone the volume the expected features are retained. We are running the latest Ceph version, KVM hosts on Ubuntu 16.04 with the latest Luminous qemu-img.
>>
> 
> How do you clone the volume manually? I assume with the rbd tool?
> 
> Because this is where Java/CloudStack clones the image:
> 
> https://github.com/apache/cloudstack/blob/master/plugins/hypervisors/kvm/src/main/java/com/cloud/hypervisor/kvm/storage/LibvirtStorageAdaptor.java#L957
> 
> 
> private int rbdFeatures = (1 << 0); /* Feature 1<<0 means layering in RBD format 2 */
> 
> rbd.clone(template.getName(), rbdTemplateSnapName, io, disk.getName(), rbdFeatures, rbdOrder);
> 
> 
> So it's on purpose and this has a historical reason which I can't thin of anymore.
> 
> We can probably update this to include exclusive-lock, object-map, fast-diff and deep-flatten. Or completely skip it and have RBD figure it out. Don't know anymore why this code is in there.
> 
> But if this a real probably that you don't have those features?
> 
> Wido
> 
>> Kind regards,
>> Glen Baars
>>
>> This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately.
>>
> This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately.
> 

RE: Ceph RBD issues in 4.11

Posted by Glen Baars <gl...@onsitecomputers.com.au>.
Hello Wido,

Thanks for the reply.

I used the RBD command line tool directly without specifying any features. It’s the default since Ceph Jewel.

The features that I require are for these use cases:

1.Using 'rbd du' the get the real disk usage of a volume without fast-diff is very slow. We need to schedule this after hours on large images.
2.We are starting to use rbd mirroring across to our secondary DC and this requires exclusive-lock.
3.Deep flatten can not be turned on after image creation. I am not sure if I require this feature at this time.

Kind regards,
Glen Baars

-----Original Message-----
From: Wido den Hollander <wi...@widodh.nl>
Sent: Thursday, 17 May 2018 10:18 PM
To: dev@cloudstack.apache.org; Glen Baars <gl...@onsitecomputers.com.au>
Subject: Re: Ceph RBD issues in 4.11



On 05/17/2018 01:50 PM, Glen Baars wrote:
> Hello Dev,
>
> I have recently upgraded our cloudstack environment to 4.11. Mostly
> all has been smooth. ( this environment is legacy from cloud.com days!
> )
>
> There are some issues that I have run into:
>
> 1.Can't install any VMs from ISO ( I have seen this in the list previously but can't find a bug report for it ) If further reports or debug will help I can assist. It is easy to reproduce.
> 2.When a VM is created from a template, the RBD features are lost. More info below.
>
> Example of VM volume from template: -
>
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info
> AUBUN-KVM-CLUSTER01-SSD/feeb52ec-f111-4a0d-9785-23aadd7650a5
>
> rbd image 'feeb52ec-f111-4a0d-9785-23aadd7650a5':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.142926a5ee64
>         format: 2
>         features: layering
>         flags:
>         create_timestamp: Fri Apr 27 12:46:21 2018
>         parent: AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-52c9307e53b4@cloudstack-base-snap
>         overlap: 150 GB
>
> Note the features are not the same as the parent : -
>
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info
> AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-52c9307e53b4
> rbd image 'd7dcd9e4-ed55-44ae-9a71-52c9307e53b4':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.141d274b0dc51
>         format: 2
>         features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
>         flags:
>         create_timestamp: Fri Apr 27 12:37:05 2018
>
>
> If you manually clone the volume the expected features are retained. We are running the latest Ceph version, KVM hosts on Ubuntu 16.04 with the latest Luminous qemu-img.
>

How do you clone the volume manually? I assume with the rbd tool?

Because this is where Java/CloudStack clones the image:

https://github.com/apache/cloudstack/blob/master/plugins/hypervisors/kvm/src/main/java/com/cloud/hypervisor/kvm/storage/LibvirtStorageAdaptor.java#L957


private int rbdFeatures = (1 << 0); /* Feature 1<<0 means layering in RBD format 2 */

rbd.clone(template.getName(), rbdTemplateSnapName, io, disk.getName(), rbdFeatures, rbdOrder);


So it's on purpose and this has a historical reason which I can't thin of anymore.

We can probably update this to include exclusive-lock, object-map, fast-diff and deep-flatten. Or completely skip it and have RBD figure it out. Don't know anymore why this code is in there.

But if this a real probably that you don't have those features?

Wido

> Kind regards,
> Glen Baars
>
> This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately.
>
This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately.

Re: Ceph RBD issues in 4.11

Posted by Wido den Hollander <wi...@widodh.nl>.

On 05/17/2018 01:50 PM, Glen Baars wrote:
> Hello Dev,
> 
> I have recently upgraded our cloudstack environment to 4.11. Mostly all has been smooth. ( this environment is legacy from cloud.com days! )
> 
> There are some issues that I have run into:
> 
> 1.Can't install any VMs from ISO ( I have seen this in the list previously but can't find a bug report for it ) If further reports or debug will help I can assist. It is easy to reproduce.
> 2.When a VM is created from a template, the RBD features are lost. More info below.
> 
> Example of VM volume from template: -
> 
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/feeb52ec-f111-4a0d-9785-23aadd7650a5
> 
> rbd image 'feeb52ec-f111-4a0d-9785-23aadd7650a5':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.142926a5ee64
>         format: 2
>         features: layering
>         flags:
>         create_timestamp: Fri Apr 27 12:46:21 2018
>         parent: AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-52c9307e53b4@cloudstack-base-snap
>         overlap: 150 GB
> 
> Note the features are not the same as the parent : -
> 
> user@NAS-AUBUN-RK3-CEPH01:~# rbd info AUBUN-KVM-CLUSTER01-SSD/d7dcd9e4-ed55-44ae-9a71-52c9307e53b4
> rbd image 'd7dcd9e4-ed55-44ae-9a71-52c9307e53b4':
>         size 150 GB in 38400 objects
>         order 22 (4096 kB objects)
>         block_name_prefix: rbd_data.141d274b0dc51
>         format: 2
>         features: layering, exclusive-lock, object-map, fast-diff, deep-flatten
>         flags:
>         create_timestamp: Fri Apr 27 12:37:05 2018
> 
> 
> If you manually clone the volume the expected features are retained. We are running the latest Ceph version, KVM hosts on Ubuntu 16.04 with the latest Luminous qemu-img.
> 

How do you clone the volume manually? I assume with the rbd tool?

Because this is where Java/CloudStack clones the image:

https://github.com/apache/cloudstack/blob/master/plugins/hypervisors/kvm/src/main/java/com/cloud/hypervisor/kvm/storage/LibvirtStorageAdaptor.java#L957


private int rbdFeatures = (1 << 0); /* Feature 1<<0 means layering in
RBD format 2 */

rbd.clone(template.getName(), rbdTemplateSnapName, io, disk.getName(),
rbdFeatures, rbdOrder);


So it's on purpose and this has a historical reason which I can't thin
of anymore.

We can probably update this to include exclusive-lock, object-map,
fast-diff and deep-flatten. Or completely skip it and have RBD figure it
out. Don't know anymore why this code is in there.

But if this a real probably that you don't have those features?

Wido

> Kind regards,
> Glen Baars
> 
> This e-mail is intended solely for the benefit of the addressee(s) and any other named recipient. It is confidential and may contain legally privileged or confidential information. If you are not the recipient, any use, distribution, disclosure or copying of this e-mail is prohibited. The confidentiality and legal privilege attached to this communication is not waived or lost by reason of the mistaken transmission or delivery to you. If you have received this e-mail in error, please notify us immediately.
>