You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by li jerry <di...@hotmail.com> on 2019/04/09 00:12:21 UTC
答复: Loop snapshots are not automatically deleted
Hi, Andrija
After the snapshot is manually created and deleted, the snapshot on ceph has been deleted normally.
Jerry
-----邮件原件-----
发件人: Andrija Panic <an...@gmail.com>
发送时间: 2019年4月8日 22:12
收件人: users <us...@cloudstack.apache.org>
抄送: dev@cloudstack.apache.org
主题: Re: Loop snapshots are not automatically deleted
Hi,
can you please test with a new volume, make a few snapshots manually, and then delete one by one, observing if snapshots is deleted from Ceph ?
Long days ago, this ^^^ was an issue, with serious consequences on performance - hope it's not back...
Andrija
On Mon, 8 Apr 2019 at 14:21, li jerry <di...@hotmail.com> wrote:
> Hi,ALL
>
> I created a loop snapshot on cloudstack 4.11.2 +CEPH
> 10.2.11.Execute at 3 am every day, keep 3 copies.After a period of
> observation, I found that the snapshot on cloudstack always shows 3
> copies.However, ceph found that the snapshot on rbd is added every day and never deleted.
>
>
>
--
Andrija Panić
答复: Loop snapshots are not automatically deleted
Posted by li jerry <di...@hotmail.com>.
Hi Andrija
Thank you very much for your reply, I will check my log.
-----邮件原件-----
发件人: Andrija Panic <an...@gmail.com>
发送时间: 2019年4月10日 0:45
收件人: users <us...@cloudstack.apache.org>
抄送: dev@cloudstack.apache.org
主题: Re: Loop snapshots are not automatically deleted
Hi Li,
both manual and scheduled snapshots work fine on Ceph - CloudStack 4.11.2 and Ceph Mimic 13.2.5 - confirmed today.
i.e.
[root@ceph1 ~]# rbd snap ls cloudstack/99b3ee82-2b2e-4d7c-85b5-f580adc6f0fb
SNAPID NAME SIZE TIMESTAMP
18 fcd4b719-b0e4-4efc-8cd4-04184af19c39 5 GiB Tue Apr 9 11:20:45 2019
19 fbc2280f-cdfd-4897-a134-dc3e0d6319a8 5 GiB Tue Apr 9 12:20:45 2019
20 db742be5-abcb-4f0c-ac51-36150d90f2d5 5 GiB Tue Apr 9 13:20:45 2019
then after few hours
[root@ceph1 ~]# rbd snap ls cloudstack/99b3ee82-2b2e-4d7c-85b5-f580adc6f0fb
SNAPID NAME SIZE TIMESTAMP
24 76ac671b-948b-4338-be44-3fcf8538f882 5 GiB Tue Apr 9 15:20:45 2019
26 deefaeb4-2cb2-4dae-a786-6d06e1f236e5 5 GiB Tue Apr 9 16:20:46 2019
28 f2997ace-00ee-4d83-bce0-2faee9f41620 5 GiB Tue Apr 9 17:20:46 2019
^^^ configured to keep last 3 hourly snapshots.
You can get into issues deleting old snapshots in cases that some of the previous schedule snapshot jobs didn't complete, or is in ERROR state and similar and then the mess can happen (had this myself some years ago).
I would suggest you examine management server logs to understand what goes wrong.
Best,
Andrija
On Tue, 9 Apr 2019 at 02:12, li jerry <di...@hotmail.com> wrote:
> Hi, Andrija
> After the snapshot is manually created and deleted, the
> snapshot on ceph has been deleted normally.
>
>
> Jerry
>
> -----邮件原件-----
> 发件人: Andrija Panic <an...@gmail.com>
> 发送时间: 2019年4月8日 22:12
> 收件人: users <us...@cloudstack.apache.org>
> 抄送: dev@cloudstack.apache.org
> 主题: Re: Loop snapshots are not automatically deleted
>
> Hi,
>
> can you please test with a new volume, make a few snapshots manually,
> and then delete one by one, observing if snapshots is deleted from Ceph ?
>
> Long days ago, this ^^^ was an issue, with serious consequences on
> performance - hope it's not back...
>
> Andrija
>
> On Mon, 8 Apr 2019 at 14:21, li jerry <di...@hotmail.com> wrote:
>
> > Hi,ALL
> >
> > I created a loop snapshot on cloudstack 4.11.2 +CEPH
> > 10.2.11.Execute at 3 am every day, keep 3 copies.After a period of
> > observation, I found that the snapshot on cloudstack always shows 3
> > copies.However, ceph found that the snapshot on rbd is added every
> > day
> and never deleted.
> >
> >
> >
>
> --
>
> Andrija Panić
>
--
Andrija Panić
答复: Loop snapshots are not automatically deleted
Posted by li jerry <di...@hotmail.com>.
Hi Andrija
Thank you very much for your reply, I will check my log.
-----邮件原件-----
发件人: Andrija Panic <an...@gmail.com>
发送时间: 2019年4月10日 0:45
收件人: users <us...@cloudstack.apache.org>
抄送: dev@cloudstack.apache.org
主题: Re: Loop snapshots are not automatically deleted
Hi Li,
both manual and scheduled snapshots work fine on Ceph - CloudStack 4.11.2 and Ceph Mimic 13.2.5 - confirmed today.
i.e.
[root@ceph1 ~]# rbd snap ls cloudstack/99b3ee82-2b2e-4d7c-85b5-f580adc6f0fb
SNAPID NAME SIZE TIMESTAMP
18 fcd4b719-b0e4-4efc-8cd4-04184af19c39 5 GiB Tue Apr 9 11:20:45 2019
19 fbc2280f-cdfd-4897-a134-dc3e0d6319a8 5 GiB Tue Apr 9 12:20:45 2019
20 db742be5-abcb-4f0c-ac51-36150d90f2d5 5 GiB Tue Apr 9 13:20:45 2019
then after few hours
[root@ceph1 ~]# rbd snap ls cloudstack/99b3ee82-2b2e-4d7c-85b5-f580adc6f0fb
SNAPID NAME SIZE TIMESTAMP
24 76ac671b-948b-4338-be44-3fcf8538f882 5 GiB Tue Apr 9 15:20:45 2019
26 deefaeb4-2cb2-4dae-a786-6d06e1f236e5 5 GiB Tue Apr 9 16:20:46 2019
28 f2997ace-00ee-4d83-bce0-2faee9f41620 5 GiB Tue Apr 9 17:20:46 2019
^^^ configured to keep last 3 hourly snapshots.
You can get into issues deleting old snapshots in cases that some of the previous schedule snapshot jobs didn't complete, or is in ERROR state and similar and then the mess can happen (had this myself some years ago).
I would suggest you examine management server logs to understand what goes wrong.
Best,
Andrija
On Tue, 9 Apr 2019 at 02:12, li jerry <di...@hotmail.com> wrote:
> Hi, Andrija
> After the snapshot is manually created and deleted, the
> snapshot on ceph has been deleted normally.
>
>
> Jerry
>
> -----邮件原件-----
> 发件人: Andrija Panic <an...@gmail.com>
> 发送时间: 2019年4月8日 22:12
> 收件人: users <us...@cloudstack.apache.org>
> 抄送: dev@cloudstack.apache.org
> 主题: Re: Loop snapshots are not automatically deleted
>
> Hi,
>
> can you please test with a new volume, make a few snapshots manually,
> and then delete one by one, observing if snapshots is deleted from Ceph ?
>
> Long days ago, this ^^^ was an issue, with serious consequences on
> performance - hope it's not back...
>
> Andrija
>
> On Mon, 8 Apr 2019 at 14:21, li jerry <di...@hotmail.com> wrote:
>
> > Hi,ALL
> >
> > I created a loop snapshot on cloudstack 4.11.2 +CEPH
> > 10.2.11.Execute at 3 am every day, keep 3 copies.After a period of
> > observation, I found that the snapshot on cloudstack always shows 3
> > copies.However, ceph found that the snapshot on rbd is added every
> > day
> and never deleted.
> >
> >
> >
>
> --
>
> Andrija Panić
>
--
Andrija Panić
Re: Loop snapshots are not automatically deleted
Posted by Andrija Panic <an...@gmail.com>.
Hi Li,
both manual and scheduled snapshots work fine on Ceph - CloudStack 4.11.2
and Ceph Mimic 13.2.5 - confirmed today.
i.e.
[root@ceph1 ~]# rbd snap ls cloudstack/99b3ee82-2b2e-4d7c-85b5-f580adc6f0fb
SNAPID NAME SIZE TIMESTAMP
18 fcd4b719-b0e4-4efc-8cd4-04184af19c39 5 GiB Tue Apr 9 11:20:45 2019
19 fbc2280f-cdfd-4897-a134-dc3e0d6319a8 5 GiB Tue Apr 9 12:20:45 2019
20 db742be5-abcb-4f0c-ac51-36150d90f2d5 5 GiB Tue Apr 9 13:20:45 2019
then after few hours
[root@ceph1 ~]# rbd snap ls cloudstack/99b3ee82-2b2e-4d7c-85b5-f580adc6f0fb
SNAPID NAME SIZE TIMESTAMP
24 76ac671b-948b-4338-be44-3fcf8538f882 5 GiB Tue Apr 9 15:20:45 2019
26 deefaeb4-2cb2-4dae-a786-6d06e1f236e5 5 GiB Tue Apr 9 16:20:46 2019
28 f2997ace-00ee-4d83-bce0-2faee9f41620 5 GiB Tue Apr 9 17:20:46 2019
^^^ configured to keep last 3 hourly snapshots.
You can get into issues deleting old snapshots in cases that some of the
previous schedule snapshot jobs didn't complete, or is in ERROR state and
similar and then the mess can happen (had this myself some years ago).
I would suggest you examine management server logs to understand what goes
wrong.
Best,
Andrija
On Tue, 9 Apr 2019 at 02:12, li jerry <di...@hotmail.com> wrote:
> Hi, Andrija
> After the snapshot is manually created and deleted, the snapshot
> on ceph has been deleted normally.
>
>
> Jerry
>
> -----邮件原件-----
> 发件人: Andrija Panic <an...@gmail.com>
> 发送时间: 2019年4月8日 22:12
> 收件人: users <us...@cloudstack.apache.org>
> 抄送: dev@cloudstack.apache.org
> 主题: Re: Loop snapshots are not automatically deleted
>
> Hi,
>
> can you please test with a new volume, make a few snapshots manually, and
> then delete one by one, observing if snapshots is deleted from Ceph ?
>
> Long days ago, this ^^^ was an issue, with serious consequences on
> performance - hope it's not back...
>
> Andrija
>
> On Mon, 8 Apr 2019 at 14:21, li jerry <di...@hotmail.com> wrote:
>
> > Hi,ALL
> >
> > I created a loop snapshot on cloudstack 4.11.2 +CEPH
> > 10.2.11.Execute at 3 am every day, keep 3 copies.After a period of
> > observation, I found that the snapshot on cloudstack always shows 3
> > copies.However, ceph found that the snapshot on rbd is added every day
> and never deleted.
> >
> >
> >
>
> --
>
> Andrija Panić
>
--
Andrija Panić
Re: Loop snapshots are not automatically deleted
Posted by Andrija Panic <an...@gmail.com>.
Hi Li,
both manual and scheduled snapshots work fine on Ceph - CloudStack 4.11.2
and Ceph Mimic 13.2.5 - confirmed today.
i.e.
[root@ceph1 ~]# rbd snap ls cloudstack/99b3ee82-2b2e-4d7c-85b5-f580adc6f0fb
SNAPID NAME SIZE TIMESTAMP
18 fcd4b719-b0e4-4efc-8cd4-04184af19c39 5 GiB Tue Apr 9 11:20:45 2019
19 fbc2280f-cdfd-4897-a134-dc3e0d6319a8 5 GiB Tue Apr 9 12:20:45 2019
20 db742be5-abcb-4f0c-ac51-36150d90f2d5 5 GiB Tue Apr 9 13:20:45 2019
then after few hours
[root@ceph1 ~]# rbd snap ls cloudstack/99b3ee82-2b2e-4d7c-85b5-f580adc6f0fb
SNAPID NAME SIZE TIMESTAMP
24 76ac671b-948b-4338-be44-3fcf8538f882 5 GiB Tue Apr 9 15:20:45 2019
26 deefaeb4-2cb2-4dae-a786-6d06e1f236e5 5 GiB Tue Apr 9 16:20:46 2019
28 f2997ace-00ee-4d83-bce0-2faee9f41620 5 GiB Tue Apr 9 17:20:46 2019
^^^ configured to keep last 3 hourly snapshots.
You can get into issues deleting old snapshots in cases that some of the
previous schedule snapshot jobs didn't complete, or is in ERROR state and
similar and then the mess can happen (had this myself some years ago).
I would suggest you examine management server logs to understand what goes
wrong.
Best,
Andrija
On Tue, 9 Apr 2019 at 02:12, li jerry <di...@hotmail.com> wrote:
> Hi, Andrija
> After the snapshot is manually created and deleted, the snapshot
> on ceph has been deleted normally.
>
>
> Jerry
>
> -----邮件原件-----
> 发件人: Andrija Panic <an...@gmail.com>
> 发送时间: 2019年4月8日 22:12
> 收件人: users <us...@cloudstack.apache.org>
> 抄送: dev@cloudstack.apache.org
> 主题: Re: Loop snapshots are not automatically deleted
>
> Hi,
>
> can you please test with a new volume, make a few snapshots manually, and
> then delete one by one, observing if snapshots is deleted from Ceph ?
>
> Long days ago, this ^^^ was an issue, with serious consequences on
> performance - hope it's not back...
>
> Andrija
>
> On Mon, 8 Apr 2019 at 14:21, li jerry <di...@hotmail.com> wrote:
>
> > Hi,ALL
> >
> > I created a loop snapshot on cloudstack 4.11.2 +CEPH
> > 10.2.11.Execute at 3 am every day, keep 3 copies.After a period of
> > observation, I found that the snapshot on cloudstack always shows 3
> > copies.However, ceph found that the snapshot on rbd is added every day
> and never deleted.
> >
> >
> >
>
> --
>
> Andrija Panić
>
--
Andrija Panić