You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Mindaugas Milinavičius <mi...@clustspace.com> on 2016/11/22 14:36:26 UTC
Disconnected XenServer 6.5 Master server
Hello,
Master server got disconnect (problem with HDD's) and now, can't
stop/restart some of VM's.
There is enabled HA, but they are not restarting on another server.
Anyone have idea, how to do it manually?
Pagarbiai
Mindaugas Milinavičius
UAB STARNITA
Direktorius
http://www.clustspace.com
LT: +37068882880
RU: +79199993933
Tomorrow's possibilities today
<http://www.clustspace.com/>
- 1 core CPU, 512MB RAM, 20GB (From €2.50)
- 1 core CPU, 1GB RAM, 30GB (From €5.00)
- 2 core CPU, 2GB RAM, 40GB (From €10.00)
- 2 core CPU, 4GB RAM, 60GB (From €20.00)
- 4 core CPU, 8GB RAM, 80GB (From €40.00)
Re: Disconnected XenServer 6.5 Master server
Posted by Dag Sonstebo <Da...@shapeblue.com>.
OK, cool. What is host 3? (select * from cloud.host where id=3 in the db).
Is this the old poolmaster? If this is the old poolmaster you probably want to put this into maintenance mode in CloudStack.
Regards,
Dag Sonstebo
On 22/11/2016, 15:15, "uabstarnita@gmail.com on behalf of Mindaugas Milinavičius" <uabstarnita@gmail.com on behalf of mindaugas@clustspace.com> wrote:
Hello,
pool master and slaves all is ok. Master new server, and slaves working
with new master. There is perfect.
xe pool-ha-disable
The operation could not be performed because HA is not enabled on the Pool
I restarted cloudstack-management service, but anyway, VM's showing online
and can't be restarted or migrated to another host
2016-11-22 17:20:53,501 WARN [o.a.c.a.c.a.v.MigrateVMCmd]
(API-Job-Executor-2:ctx-fe868303 job-3755 ctx-4e021994) (logid:97c86433)
Exception:
com.cloud.exception.AgentUnavailableException: Resource [Host:3] is
unreachable: Host 3: Host with specified id is not in the right state: Alert
at
com.cloud.agent.manager.ClusteredAgentManagerImpl.getAttache(ClusteredAgentManagerImpl.java:568)
at
com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:446)
at
com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:360)
Pagarbiai
Mindaugas Milinavičius
UAB STARNITA
Direktorius
http://www.clustspace.com
LT: +37068882880
RU: +79199993933
Tomorrow's possibilities today
<http://www.clustspace.com/>
- 1 core CPU, 512MB RAM, 20GB (From €2.50)
- 1 core CPU, 1GB RAM, 30GB (From €5.00)
- 2 core CPU, 2GB RAM, 40GB (From €10.00)
- 2 core CPU, 4GB RAM, 60GB (From €20.00)
- 4 core CPU, 8GB RAM, 80GB (From €40.00)
On Tue, Nov 22, 2016 at 6:02 PM, Dag Sonstebo <Da...@shapeblue.com>
wrote:
> I would first of all check your new master thoroughly with the below
> commands, then check your XS slaves - do a “more /etc/xensource/pool.conf”
> on all of them to check that they all agree point to the new poolmaster (in
> fact carry this step out on the new master as well). If not you may have to
> do a “xe pool-recover-slaves”. There may be other steps required as well –
> you may have to disable HA temporarily (xe pool-ha-disable) + do some
> xe-toolstack-restarts.
>
> Once you are fully happy the XenServer cluster is healthy you might have
> to restart your cloudstack-management service.
>
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
>
> On 22/11/2016, 14:51, "uabstarnita@gmail.com on behalf of Mindaugas
> Milinavičius" <uabstarnita@gmail.com on behalf of mindaugas@clustspace.com>
> wrote:
>
> Hello,
>
> i did xe pool-emergency-transition-to-master and other server started
> and
> connected.
>
> But my master server is not bootable at the moment, and i can't
> stop/restart or migrate instance to another host, because on cloudstack
> still showing old server like master....How to change master at
> cloudstack
> to the new one?
>
>
>
>
> Pagarbiai
> Mindaugas Milinavičius
> UAB STARNITA
> Direktorius
> http://www.clustspace.com
> LT: +37068882880
> RU: +79199993933
>
> Tomorrow's possibilities today
> <http://www.clustspace.com/>
>
> - 1 core CPU, 512MB RAM, 20GB (From €2.50)
> - 1 core CPU, 1GB RAM, 30GB (From €5.00)
> - 2 core CPU, 2GB RAM, 40GB (From €10.00)
> - 2 core CPU, 4GB RAM, 60GB (From €20.00)
> - 4 core CPU, 8GB RAM, 80GB (From €40.00)
>
>
> On Tue, Nov 22, 2016 at 5:48 PM, Dag Sonstebo <
> Dag.Sonstebo@shapeblue.com>
> wrote:
>
> > Are the other XS hosts showing as healthy in CloudStack? This can
> > sometimes be a XenServer issue – where a new poolmaster isn’t
> assigned
> > properly.
> >
> > Check the current state of your cluster (“xe host-list / xe
> pool-list /
> > more /etc/xensource/pool.conf”) + if it’s not healthy you may need
> to do a
> > “xe pool-designate-new-master” (or worst case “xe
> > pool-emergency-transition-to-master”).
> >
> > Regards,
> > Dag Sonstebo
> > Cloud Architect
> > ShapeBlue
> >
> > On 22/11/2016, 14:36, "uabstarnita@gmail.com on behalf of Mindaugas
> > Milinavičius" <uabstarnita@gmail.com on behalf of
> mindaugas@clustspace.com>
> > wrote:
> >
> > Hello,
> >
> > Master server got disconnect (problem with HDD's) and now, can't
> > stop/restart some of VM's.
> >
> > There is enabled HA, but they are not restarting on another
> server.
> >
> > Anyone have idea, how to do it manually?
> >
> >
> >
> > Pagarbiai
> > Mindaugas Milinavičius
> > UAB STARNITA
> > Direktorius
> > http://www.clustspace.com
> > LT: +37068882880
> > RU: +79199993933
> >
> > Tomorrow's possibilities today
> > <http://www.clustspace.com/>
> >
> > - 1 core CPU, 512MB RAM, 20GB (From €2.50)
> > - 1 core CPU, 1GB RAM, 30GB (From €5.00)
> > - 2 core CPU, 2GB RAM, 40GB (From €10.00)
> > - 2 core CPU, 4GB RAM, 60GB (From €20.00)
> > - 4 core CPU, 8GB RAM, 80GB (From €40.00)
> >
> >
> >
> > Dag.Sonstebo@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
>
>
>
> Dag.Sonstebo@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London WC2N 4HSUK
> @shapeblue
>
>
>
>
Dag.Sonstebo@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London WC2N 4HSUK
@shapeblue
Re: Disconnected XenServer 6.5 Master server
Posted by Mindaugas Milinavičius <mi...@clustspace.com>.
Hello,
pool master and slaves all is ok. Master new server, and slaves working
with new master. There is perfect.
xe pool-ha-disable
The operation could not be performed because HA is not enabled on the Pool
I restarted cloudstack-management service, but anyway, VM's showing online
and can't be restarted or migrated to another host
2016-11-22 17:20:53,501 WARN [o.a.c.a.c.a.v.MigrateVMCmd]
(API-Job-Executor-2:ctx-fe868303 job-3755 ctx-4e021994) (logid:97c86433)
Exception:
com.cloud.exception.AgentUnavailableException: Resource [Host:3] is
unreachable: Host 3: Host with specified id is not in the right state: Alert
at
com.cloud.agent.manager.ClusteredAgentManagerImpl.getAttache(ClusteredAgentManagerImpl.java:568)
at
com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:446)
at
com.cloud.agent.manager.AgentManagerImpl.send(AgentManagerImpl.java:360)
Pagarbiai
Mindaugas Milinavičius
UAB STARNITA
Direktorius
http://www.clustspace.com
LT: +37068882880
RU: +79199993933
Tomorrow's possibilities today
<http://www.clustspace.com/>
- 1 core CPU, 512MB RAM, 20GB (From €2.50)
- 1 core CPU, 1GB RAM, 30GB (From €5.00)
- 2 core CPU, 2GB RAM, 40GB (From €10.00)
- 2 core CPU, 4GB RAM, 60GB (From €20.00)
- 4 core CPU, 8GB RAM, 80GB (From €40.00)
On Tue, Nov 22, 2016 at 6:02 PM, Dag Sonstebo <Da...@shapeblue.com>
wrote:
> I would first of all check your new master thoroughly with the below
> commands, then check your XS slaves - do a “more /etc/xensource/pool.conf”
> on all of them to check that they all agree point to the new poolmaster (in
> fact carry this step out on the new master as well). If not you may have to
> do a “xe pool-recover-slaves”. There may be other steps required as well –
> you may have to disable HA temporarily (xe pool-ha-disable) + do some
> xe-toolstack-restarts.
>
> Once you are fully happy the XenServer cluster is healthy you might have
> to restart your cloudstack-management service.
>
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
>
> On 22/11/2016, 14:51, "uabstarnita@gmail.com on behalf of Mindaugas
> Milinavičius" <uabstarnita@gmail.com on behalf of mindaugas@clustspace.com>
> wrote:
>
> Hello,
>
> i did xe pool-emergency-transition-to-master and other server started
> and
> connected.
>
> But my master server is not bootable at the moment, and i can't
> stop/restart or migrate instance to another host, because on cloudstack
> still showing old server like master....How to change master at
> cloudstack
> to the new one?
>
>
>
>
> Pagarbiai
> Mindaugas Milinavičius
> UAB STARNITA
> Direktorius
> http://www.clustspace.com
> LT: +37068882880
> RU: +79199993933
>
> Tomorrow's possibilities today
> <http://www.clustspace.com/>
>
> - 1 core CPU, 512MB RAM, 20GB (From €2.50)
> - 1 core CPU, 1GB RAM, 30GB (From €5.00)
> - 2 core CPU, 2GB RAM, 40GB (From €10.00)
> - 2 core CPU, 4GB RAM, 60GB (From €20.00)
> - 4 core CPU, 8GB RAM, 80GB (From €40.00)
>
>
> On Tue, Nov 22, 2016 at 5:48 PM, Dag Sonstebo <
> Dag.Sonstebo@shapeblue.com>
> wrote:
>
> > Are the other XS hosts showing as healthy in CloudStack? This can
> > sometimes be a XenServer issue – where a new poolmaster isn’t
> assigned
> > properly.
> >
> > Check the current state of your cluster (“xe host-list / xe
> pool-list /
> > more /etc/xensource/pool.conf”) + if it’s not healthy you may need
> to do a
> > “xe pool-designate-new-master” (or worst case “xe
> > pool-emergency-transition-to-master”).
> >
> > Regards,
> > Dag Sonstebo
> > Cloud Architect
> > ShapeBlue
> >
> > On 22/11/2016, 14:36, "uabstarnita@gmail.com on behalf of Mindaugas
> > Milinavičius" <uabstarnita@gmail.com on behalf of
> mindaugas@clustspace.com>
> > wrote:
> >
> > Hello,
> >
> > Master server got disconnect (problem with HDD's) and now, can't
> > stop/restart some of VM's.
> >
> > There is enabled HA, but they are not restarting on another
> server.
> >
> > Anyone have idea, how to do it manually?
> >
> >
> >
> > Pagarbiai
> > Mindaugas Milinavičius
> > UAB STARNITA
> > Direktorius
> > http://www.clustspace.com
> > LT: +37068882880
> > RU: +79199993933
> >
> > Tomorrow's possibilities today
> > <http://www.clustspace.com/>
> >
> > - 1 core CPU, 512MB RAM, 20GB (From €2.50)
> > - 1 core CPU, 1GB RAM, 30GB (From €5.00)
> > - 2 core CPU, 2GB RAM, 40GB (From €10.00)
> > - 2 core CPU, 4GB RAM, 60GB (From €20.00)
> > - 4 core CPU, 8GB RAM, 80GB (From €40.00)
> >
> >
> >
> > Dag.Sonstebo@shapeblue.com
> > www.shapeblue.com
> > 53 Chandos Place, Covent Garden, London WC2N 4HSUK
> > @shapeblue
> >
> >
> >
> >
>
>
>
> Dag.Sonstebo@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London WC2N 4HSUK
> @shapeblue
>
>
>
>
Re: Disconnected XenServer 6.5 Master server
Posted by Dag Sonstebo <Da...@shapeblue.com>.
I would first of all check your new master thoroughly with the below commands, then check your XS slaves - do a “more /etc/xensource/pool.conf” on all of them to check that they all agree point to the new poolmaster (in fact carry this step out on the new master as well). If not you may have to do a “xe pool-recover-slaves”. There may be other steps required as well – you may have to disable HA temporarily (xe pool-ha-disable) + do some xe-toolstack-restarts.
Once you are fully happy the XenServer cluster is healthy you might have to restart your cloudstack-management service.
Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue
On 22/11/2016, 14:51, "uabstarnita@gmail.com on behalf of Mindaugas Milinavičius" <uabstarnita@gmail.com on behalf of mindaugas@clustspace.com> wrote:
Hello,
i did xe pool-emergency-transition-to-master and other server started and
connected.
But my master server is not bootable at the moment, and i can't
stop/restart or migrate instance to another host, because on cloudstack
still showing old server like master....How to change master at cloudstack
to the new one?
Pagarbiai
Mindaugas Milinavičius
UAB STARNITA
Direktorius
http://www.clustspace.com
LT: +37068882880
RU: +79199993933
Tomorrow's possibilities today
<http://www.clustspace.com/>
- 1 core CPU, 512MB RAM, 20GB (From €2.50)
- 1 core CPU, 1GB RAM, 30GB (From €5.00)
- 2 core CPU, 2GB RAM, 40GB (From €10.00)
- 2 core CPU, 4GB RAM, 60GB (From €20.00)
- 4 core CPU, 8GB RAM, 80GB (From €40.00)
On Tue, Nov 22, 2016 at 5:48 PM, Dag Sonstebo <Da...@shapeblue.com>
wrote:
> Are the other XS hosts showing as healthy in CloudStack? This can
> sometimes be a XenServer issue – where a new poolmaster isn’t assigned
> properly.
>
> Check the current state of your cluster (“xe host-list / xe pool-list /
> more /etc/xensource/pool.conf”) + if it’s not healthy you may need to do a
> “xe pool-designate-new-master” (or worst case “xe
> pool-emergency-transition-to-master”).
>
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
>
> On 22/11/2016, 14:36, "uabstarnita@gmail.com on behalf of Mindaugas
> Milinavičius" <uabstarnita@gmail.com on behalf of mindaugas@clustspace.com>
> wrote:
>
> Hello,
>
> Master server got disconnect (problem with HDD's) and now, can't
> stop/restart some of VM's.
>
> There is enabled HA, but they are not restarting on another server.
>
> Anyone have idea, how to do it manually?
>
>
>
> Pagarbiai
> Mindaugas Milinavičius
> UAB STARNITA
> Direktorius
> http://www.clustspace.com
> LT: +37068882880
> RU: +79199993933
>
> Tomorrow's possibilities today
> <http://www.clustspace.com/>
>
> - 1 core CPU, 512MB RAM, 20GB (From €2.50)
> - 1 core CPU, 1GB RAM, 30GB (From €5.00)
> - 2 core CPU, 2GB RAM, 40GB (From €10.00)
> - 2 core CPU, 4GB RAM, 60GB (From €20.00)
> - 4 core CPU, 8GB RAM, 80GB (From €40.00)
>
>
>
> Dag.Sonstebo@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London WC2N 4HSUK
> @shapeblue
>
>
>
>
Dag.Sonstebo@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London WC2N 4HSUK
@shapeblue
Re: Disconnected XenServer 6.5 Master server
Posted by Mindaugas Milinavičius <mi...@clustspace.com>.
Hello,
i did xe pool-emergency-transition-to-master and other server started and
connected.
But my master server is not bootable at the moment, and i can't
stop/restart or migrate instance to another host, because on cloudstack
still showing old server like master....How to change master at cloudstack
to the new one?
Pagarbiai
Mindaugas Milinavičius
UAB STARNITA
Direktorius
http://www.clustspace.com
LT: +37068882880
RU: +79199993933
Tomorrow's possibilities today
<http://www.clustspace.com/>
- 1 core CPU, 512MB RAM, 20GB (From €2.50)
- 1 core CPU, 1GB RAM, 30GB (From €5.00)
- 2 core CPU, 2GB RAM, 40GB (From €10.00)
- 2 core CPU, 4GB RAM, 60GB (From €20.00)
- 4 core CPU, 8GB RAM, 80GB (From €40.00)
On Tue, Nov 22, 2016 at 5:48 PM, Dag Sonstebo <Da...@shapeblue.com>
wrote:
> Are the other XS hosts showing as healthy in CloudStack? This can
> sometimes be a XenServer issue – where a new poolmaster isn’t assigned
> properly.
>
> Check the current state of your cluster (“xe host-list / xe pool-list /
> more /etc/xensource/pool.conf”) + if it’s not healthy you may need to do a
> “xe pool-designate-new-master” (or worst case “xe
> pool-emergency-transition-to-master”).
>
> Regards,
> Dag Sonstebo
> Cloud Architect
> ShapeBlue
>
> On 22/11/2016, 14:36, "uabstarnita@gmail.com on behalf of Mindaugas
> Milinavičius" <uabstarnita@gmail.com on behalf of mindaugas@clustspace.com>
> wrote:
>
> Hello,
>
> Master server got disconnect (problem with HDD's) and now, can't
> stop/restart some of VM's.
>
> There is enabled HA, but they are not restarting on another server.
>
> Anyone have idea, how to do it manually?
>
>
>
> Pagarbiai
> Mindaugas Milinavičius
> UAB STARNITA
> Direktorius
> http://www.clustspace.com
> LT: +37068882880
> RU: +79199993933
>
> Tomorrow's possibilities today
> <http://www.clustspace.com/>
>
> - 1 core CPU, 512MB RAM, 20GB (From €2.50)
> - 1 core CPU, 1GB RAM, 30GB (From €5.00)
> - 2 core CPU, 2GB RAM, 40GB (From €10.00)
> - 2 core CPU, 4GB RAM, 60GB (From €20.00)
> - 4 core CPU, 8GB RAM, 80GB (From €40.00)
>
>
>
> Dag.Sonstebo@shapeblue.com
> www.shapeblue.com
> 53 Chandos Place, Covent Garden, London WC2N 4HSUK
> @shapeblue
>
>
>
>
Re: Disconnected XenServer 6.5 Master server
Posted by Dag Sonstebo <Da...@shapeblue.com>.
Are the other XS hosts showing as healthy in CloudStack? This can sometimes be a XenServer issue – where a new poolmaster isn’t assigned properly.
Check the current state of your cluster (“xe host-list / xe pool-list / more /etc/xensource/pool.conf”) + if it’s not healthy you may need to do a “xe pool-designate-new-master” (or worst case “xe pool-emergency-transition-to-master”).
Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue
On 22/11/2016, 14:36, "uabstarnita@gmail.com on behalf of Mindaugas Milinavičius" <uabstarnita@gmail.com on behalf of mindaugas@clustspace.com> wrote:
Hello,
Master server got disconnect (problem with HDD's) and now, can't
stop/restart some of VM's.
There is enabled HA, but they are not restarting on another server.
Anyone have idea, how to do it manually?
Pagarbiai
Mindaugas Milinavičius
UAB STARNITA
Direktorius
http://www.clustspace.com
LT: +37068882880
RU: +79199993933
Tomorrow's possibilities today
<http://www.clustspace.com/>
- 1 core CPU, 512MB RAM, 20GB (From €2.50)
- 1 core CPU, 1GB RAM, 30GB (From €5.00)
- 2 core CPU, 2GB RAM, 40GB (From €10.00)
- 2 core CPU, 4GB RAM, 60GB (From €20.00)
- 4 core CPU, 8GB RAM, 80GB (From €40.00)
Dag.Sonstebo@shapeblue.com
www.shapeblue.com
53 Chandos Place, Covent Garden, London WC2N 4HSUK
@shapeblue