You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by benoit lair <ku...@gmail.com> on 2021/10/20 13:24:33 UTC
ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Hello,
I am trying to migrate my first NFS secondary storage to a second NFS one
I asked for a migration with a migration policy "complete"
The job is working but finishes before migrating all the data
I had to relaunch the migration which continues
Any ideas ?
Regards, Benoit
Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Posted by benoit lair <ku...@gmail.com>.
I found why the other templates didn't were migrated on 2nd sec storage
server
Mgmt Server was blocked on template vm id1 (system vm template)
In fact in initialised sys template vm from ACS mgmt server to 2nd sec
storage server with : cloud-install-sys-tmplt
So it was blocked to this operation
Finally i tried to help ACS server, moving the template id1 folder from 1st
sec storage to 2nd sec storage
I finally got the other templates downloaded onto my 2nd sec storage server
But after restarting ACS mgmt server, the template id1 folder has been
deleted on both secondary storage servers
I still have entries on BDD for template id1 on store_id 1 and store_id 2,
but the folder does not exist anymore ! :/
How can i get back my system vm template ? i cant start any system vm
routers
Thanks for your help
Regards, Benoit
Le mar. 26 oct. 2021 à 16:56, Pearl d'Silva <pe...@shapeblue.com> a
écrit :
> One way to identify it would be to check the vm_template table for
> templates that are marked as public but do not have a url (i.e., null) -
> such templates should be migrated, but maybe skipped, as in 4.15, public
> templates aren't migrated as they get downloaded on all stores in a zone.
> However, such templates i.e., templates created from volumes / snapshots
> that are marked as public do not get synced. This was addressed in
> https://github.com/apache/cloudstack/pull/5404
>
>
> Thanks,
> ________________________________
> From: benoit lair <ku...@gmail.com>
> Sent: Tuesday, October 26, 2021 8:01 PM
> To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
> Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers
> interrupted
>
> Hi Pearl,
>
> I am checking the logs of the mgmt server
> About the possibility the template came from a volume, is there way to
> check this in database ?
>
> Regards, Benoit
>
> Le mar. 26 oct. 2021 à 14:53, Pearl d'Silva <pe...@shapeblue.com> a
> écrit :
>
> > Hi Benoit,
> >
> > Can you please check the logs to see if the specific data objects were
> > skipped from being migrated because they couldn't be accomodated on the
> > destination store. Also, were these templates that were left behind
> created
> > from volumes / snapshots - in that case, in 4.15, it is a known issue to
> > skip those files, and has been addressed in 4.16.
> >
> > Thanks,
> > Pearl
> > ________________________________
> > From: benoit lair <ku...@gmail.com>
> > Sent: Tuesday, October 26, 2021 5:35 PM
> > To: users@cloudstack.apache.org <us...@cloudstack.apache.org>;
> > dev@cloudstack.apache.org <de...@cloudstack.apache.org>
> > Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers
> > interrupted
> >
> > Hello Guys,
> >
> > I have still the problem on ACS 4.15
> > I am trying to migrate my first nfs secondary storage server to another
> nfs
> > server
> > ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA :
> > Successfully
> > completed migrating Image store data. Migrating files/data objects from :
> > NFS Secondary storage 001 to: [NFS Secondary storage 002]
> >
> > However, there are still templates hosted on the primary nfs server
> >
> > any ideas why the migration does not work as expected ?
> >
> > Regards, Benoit
> > Le mer. 20 oct. 2021 à 15:24, benoit lair <ku...@gmail.com> a
> écrit
> > :
> >
> > > Hello,
> > >
> > > I am trying to migrate my first NFS secondary storage to a second NFS
> one
> > > I asked for a migration with a migration policy "complete"
> > > The job is working but finishes before migrating all the data
> > >
> > > I had to relaunch the migration which continues
> > >
> > > Any ideas ?
> > >
> > > Regards, Benoit
> > >
> >
> >
> >
> >
>
>
>
>
Re: ACS 4.15.1 Migration between NFS Secondary storage
servers interrupted
Posted by Pearl d'Silva <pe...@shapeblue.com>.
One way to identify it would be to check the vm_template table for templates that are marked as public but do not have a url (i.e., null) - such templates should be migrated, but maybe skipped, as in 4.15, public templates aren't migrated as they get downloaded on all stores in a zone. However, such templates i.e., templates created from volumes / snapshots that are marked as public do not get synced. This was addressed in https://github.com/apache/cloudstack/pull/5404
Thanks,
________________________________
From: benoit lair <ku...@gmail.com>
Sent: Tuesday, October 26, 2021 8:01 PM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Hi Pearl,
I am checking the logs of the mgmt server
About the possibility the template came from a volume, is there way to
check this in database ?
Regards, Benoit
Le mar. 26 oct. 2021 à 14:53, Pearl d'Silva <pe...@shapeblue.com> a
écrit :
> Hi Benoit,
>
> Can you please check the logs to see if the specific data objects were
> skipped from being migrated because they couldn't be accomodated on the
> destination store. Also, were these templates that were left behind created
> from volumes / snapshots - in that case, in 4.15, it is a known issue to
> skip those files, and has been addressed in 4.16.
>
> Thanks,
> Pearl
> ________________________________
> From: benoit lair <ku...@gmail.com>
> Sent: Tuesday, October 26, 2021 5:35 PM
> To: users@cloudstack.apache.org <us...@cloudstack.apache.org>;
> dev@cloudstack.apache.org <de...@cloudstack.apache.org>
> Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers
> interrupted
>
> Hello Guys,
>
> I have still the problem on ACS 4.15
> I am trying to migrate my first nfs secondary storage server to another nfs
> server
> ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA :
> Successfully
> completed migrating Image store data. Migrating files/data objects from :
> NFS Secondary storage 001 to: [NFS Secondary storage 002]
>
> However, there are still templates hosted on the primary nfs server
>
> any ideas why the migration does not work as expected ?
>
> Regards, Benoit
> Le mer. 20 oct. 2021 à 15:24, benoit lair <ku...@gmail.com> a écrit
> :
>
> > Hello,
> >
> > I am trying to migrate my first NFS secondary storage to a second NFS one
> > I asked for a migration with a migration policy "complete"
> > The job is working but finishes before migrating all the data
> >
> > I had to relaunch the migration which continues
> >
> > Any ideas ?
> >
> > Regards, Benoit
> >
>
>
>
>
Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Posted by benoit lair <ku...@gmail.com>.
Hi Pearl,
I am checking the logs of the mgmt server
About the possibility the template came from a volume, is there way to
check this in database ?
Regards, Benoit
Le mar. 26 oct. 2021 à 14:53, Pearl d'Silva <pe...@shapeblue.com> a
écrit :
> Hi Benoit,
>
> Can you please check the logs to see if the specific data objects were
> skipped from being migrated because they couldn't be accomodated on the
> destination store. Also, were these templates that were left behind created
> from volumes / snapshots - in that case, in 4.15, it is a known issue to
> skip those files, and has been addressed in 4.16.
>
> Thanks,
> Pearl
> ________________________________
> From: benoit lair <ku...@gmail.com>
> Sent: Tuesday, October 26, 2021 5:35 PM
> To: users@cloudstack.apache.org <us...@cloudstack.apache.org>;
> dev@cloudstack.apache.org <de...@cloudstack.apache.org>
> Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers
> interrupted
>
> Hello Guys,
>
> I have still the problem on ACS 4.15
> I am trying to migrate my first nfs secondary storage server to another nfs
> server
> ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA :
> Successfully
> completed migrating Image store data. Migrating files/data objects from :
> NFS Secondary storage 001 to: [NFS Secondary storage 002]
>
> However, there are still templates hosted on the primary nfs server
>
> any ideas why the migration does not work as expected ?
>
> Regards, Benoit
> Le mer. 20 oct. 2021 à 15:24, benoit lair <ku...@gmail.com> a écrit
> :
>
> > Hello,
> >
> > I am trying to migrate my first NFS secondary storage to a second NFS one
> > I asked for a migration with a migration policy "complete"
> > The job is working but finishes before migrating all the data
> >
> > I had to relaunch the migration which continues
> >
> > Any ideas ?
> >
> > Regards, Benoit
> >
>
>
>
>
Re: ACS 4.15.1 Migration between NFS Secondary storage
servers interrupted
Posted by Pearl d'Silva <pe...@shapeblue.com>.
Hi Benoit,
Can you please check the logs to see if the specific data objects were skipped from being migrated because they couldn't be accomodated on the destination store. Also, were these templates that were left behind created from volumes / snapshots - in that case, in 4.15, it is a known issue to skip those files, and has been addressed in 4.16.
Thanks,
Pearl
________________________________
From: benoit lair <ku...@gmail.com>
Sent: Tuesday, October 26, 2021 5:35 PM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>; dev@cloudstack.apache.org <de...@cloudstack.apache.org>
Subject: Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Hello Guys,
I have still the problem on ACS 4.15
I am trying to migrate my first nfs secondary storage server to another nfs
server
ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : Successfully
completed migrating Image store data. Migrating files/data objects from :
NFS Secondary storage 001 to: [NFS Secondary storage 002]
However, there are still templates hosted on the primary nfs server
any ideas why the migration does not work as expected ?
Regards, Benoit
Le mer. 20 oct. 2021 à 15:24, benoit lair <ku...@gmail.com> a écrit :
> Hello,
>
> I am trying to migrate my first NFS secondary storage to a second NFS one
> I asked for a migration with a migration policy "complete"
> The job is working but finishes before migrating all the data
>
> I had to relaunch the migration which continues
>
> Any ideas ?
>
> Regards, Benoit
>
Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Posted by benoit lair <ku...@gmail.com>.
Hello Guys,
I have still the problem on ACS 4.15
I am trying to migrate my first nfs secondary storage server to another nfs
server
ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : Successfully
completed migrating Image store data. Migrating files/data objects from :
NFS Secondary storage 001 to: [NFS Secondary storage 002]
However, there are still templates hosted on the primary nfs server
any ideas why the migration does not work as expected ?
Regards, Benoit
Le mer. 20 oct. 2021 à 15:24, benoit lair <ku...@gmail.com> a écrit :
> Hello,
>
> I am trying to migrate my first NFS secondary storage to a second NFS one
> I asked for a migration with a migration policy "complete"
> The job is working but finishes before migrating all the data
>
> I had to relaunch the migration which continues
>
> Any ideas ?
>
> Regards, Benoit
>
Re: ACS 4.15.1 Migration between NFS Secondary storage servers interrupted
Posted by benoit lair <ku...@gmail.com>.
Hello Guys,
I have still the problem on ACS 4.15
I am trying to migrate my first nfs secondary storage server to another nfs
server
ACS says in the events the migration is IMAGE.STORE.MIGRATE.DATA : Successfully
completed migrating Image store data. Migrating files/data objects from :
NFS Secondary storage 001 to: [NFS Secondary storage 002]
However, there are still templates hosted on the primary nfs server
any ideas why the migration does not work as expected ?
Regards, Benoit
Le mer. 20 oct. 2021 à 15:24, benoit lair <ku...@gmail.com> a écrit :
> Hello,
>
> I am trying to migrate my first NFS secondary storage to a second NFS one
> I asked for a migration with a migration policy "complete"
> The job is working but finishes before migrating all the data
>
> I had to relaunch the migration which continues
>
> Any ideas ?
>
> Regards, Benoit
>