You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Kyle Flavin <ky...@citrix.com> on 2015/01/28 01:50:15 UTC
Removing a host from a cluster and adding it to another
I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
On the Xen host itself, I see the following in the xensource.log:
Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
Thanks,
Kyle
RE: Removing a host from a cluster and adding it to another
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Kyle,
The official advice has always been to re-install a XenServer before trying to add it back into CloudStack.
When a host is added into CloudStack a number of changes are made, and whilst it is possible to manually clean up the configuration, there is always a risk you miss something which could cause you problems later on.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Abhinandan Prateek [mailto:abhinandan.prateek@shapeblue.com]
Sent: 28 January 2015 05:56
To: users@cloudstack.apache.org
Subject: Re: Removing a host from a cluster and adding it to another
The tag needs to be removed from the Xen Hypervisor so that it cleanly goes to another cluster. Use the following to clear host tags after detaching it from the pool:
xe host-param-clear uuid=$host param-name=tags; (Run it in moving Xen host)
You also need to clear the SR on this host so that there is no conflict when it is added to another cluster. Following are the steps to clear the SR:
[root@xenserver1-cloudstack ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
.....
172.16.197.134:/opt/storage/primary
19856384 2560128 16300160 14% /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a
[root@xenserver1-cloudstack ~]# xe pbd-list sr-uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
uuid ( RO) : 2e2aced7-f27f-917f-a017-68f3504967f0
..
[root@xenserver1-cloudstack ~]# xe pbd-unplug uuid=2e2aced7-f27f-917f-a017-68f3504967f0
[root@xenserver1-cloudstack ~]# xe sr-forget uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
# for pbd in `xe pbd-list currently-attached=false| grep ^uuid | awk '{print $NF}'`; do xe pbd-plug uuid=$pbd ; done
Regards,
Abhinandan Prateek
M +919701199011
abhinandan.prateek@shapeblue.com
> On 28-Jan-2015, at 9:49 am, Kyle Flavin <ky...@citrix.com> wrote:
>
> Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
>
> select * from host_tags where host_id=<host_id>;
>
> +-----+---------+----------------+
> | id | host_id | tag |
> +-----+---------+----------------+
> | <id> | <hosted> | <host_name> |
> +-----+---------+----------------+
>
> Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
>
> -----Original Message-----
> From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
> Sent: Tuesday, January 27, 2015 5:20 PM
> To: users@cloudstack.apache.org
> Subject: RE: Removing a host from a cluster and adding it to another
>
> Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
>
> Regards,
> Somesh
>
>
> -----Original Message-----
> From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
> Sent: Tuesday, January 27, 2015 7:50 PM
> To: users@cloudstack.apache.org
> Subject: Removing a host from a cluster and adding it to another
>
> I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
>
> Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
>
> 2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
>
> On the Xen host itself, I see the following in the xensource.log:
>
> Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
>
> It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
>
> Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
>
> Thanks,
> Kyle
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Removing a host from a cluster and adding it to another
Posted by Somesh Naidu <So...@citrix.com>.
Kyle, I'd expect the use case you mentioned to work.
Based on your comments so far I'd be surprised if it is something obvious. I was thinking it would be better to have a closer look at what's happening. Would you be available for a GTM?
Somesh
CloudPlatform Escalations
Citrix Systems, Inc.
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: Wednesday, January 28, 2015 6:37 PM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Unfortunately, I'm still running into issues adding my Xen host to the Cloudstack cluster, even after reinstalling the host. When I attempt to add the new host, I get a "Failed to add host" message in the web UI. As before, xensource.log doesn't show any errors other than this:
/opt/xensource/bin/xapi: [debug|<hostnameremoved>|620 INET 0.0.0.0:80|pool_patch.get_by_uuid D:b910526acfa9|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID:
I feel like I'm probably missing something obvious, but I haven't been able to figure out what.
I'm following the Cloudstack installation Guide for Xenserver, as well as the Xenserver 6.2 Installation Guide (PDF):
http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/hypervisor/xenserver.html
I did the following:
- Reinstalled Xenserver from scratch.
- Attached to the host from XenCenter, and created a new pool and added the host (it's the only host in the pool)
- Went into the Cloudstack WebUI and created a new Cluster (this cluster exists in the same pod as the old cluster)
- Tried to add the host, and received the failure message
One thing I did notice (prior to rebuilding) is that I was able to re-add the host back into to the original cluster it had been a part of. I just could not add it to the new cluster (I haven't tried again with the fresh install just yet, because the install took 2.5 hours, and I want to investigate other possibilities). So I'm wondering if there are some artifacts being left in Cloudstack that are preventing me from adding the host to the new cluster? I reused the hostname, so it seems like it might make sense that it could be an issue. I do still see references in the database to the hostname in the "host" table, although it's shown as "removed".
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: Wednesday, January 28, 2015 9:46 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Got it. Option #1 is probably what I'll end up doing eventually. But I'm hesitant to do that on my first try on a cluster with running VM's. I'd like to see the upgrade process first.
I think I'll start by creating a one node cluster as planned, just to see the upgrade process. Then I'll circle back and attempt option #1 on the existing cluster. Actually, there are multiple clusters running 6.2, so it makes sense to do them in place once I can get a process in order.
Thanks for your help.
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Wednesday, January 28, 2015 9:33 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Kyle,
If your main goal was to upgrade the Cluster to XenServer 6.5 you have two options.
1. Upgrade the cluster in-situ, and you can use this guide to help you http://shapeblue.com/citrix/how-to-upgrade-an-apache-cloudstack-citrix-xenserver-cluster/
2. Build a new Cluster with cleanly installed Hosts and then live migrate the VMs into the new Cluster
Option 1 does not involve taking hosts out of the Cluster, the key is to upgrade the Pool Master (and only the pool master) first, then upgrade remaining hosts one at a time.
For option 2 you need to ensure each Cluster has 3 Hosts before you put any Client VMs on them as running Clusters with less than three Hosts in production is definitely not recommended.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 17:20
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Hi Geoff,
So question for you. The purpose behind me doing this is to test upgrade a single host from Xen 6.2 to 6.5. I was moving the host out of its original cluster so as not to impact any running VM's in the existing cluster (I haven't attempted to upgrade XenServer before, so I want to be extra careful). Does that approach makes sense to you? Given the time I've sunk into this over the past day, I'm thinking I may reinstall with Xen 6.2, add it to its own CS cluster, and then attempt the upgrade to 6.5.
Kyle
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Wednesday, January 28, 2015 9:04 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Kyle,
I'm guessing there is still something referencing the old Pool the Host used to belong to which is causing the problem.
I really recommend you just re-install XenServer from scratch and have a clean host.
A XenServer 6.5 install takes literally 10 mins to do a manual install as there are no Hotfixes to apply yet, a XenServer 6.2 install can take an hour due to all the Hotfixes but you only need to apply the following as they contain all the others not listed:
XS62ESP1.xsupdate
XS62ESP1003.xsupdate
XS62ESP1005.xsupdate
XS62ESP1009.xsupdate
XS62ESP1014.xsupdate
XS62ESP1016.xsupdate
So that would be six reboots of the host to apply all the patches up to XS62ESP1016
I also recommend you invest some time setting up a PXE deployment architecture which can auto install XenServer and all the patches, then if you ever need to re-install a host or deploy a new one, you can do so with very little effort and enjoy a nice hot coffee while it does all the work for you.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 16:50
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
I seem to be a little closer. I've cleared the tags and the SR on my host. When I try to add the host to my new cluster through the Cloudstack web UI, I now see this:
"Please join the host <IP> to XS pool <UUID> through XC/XS before adding it through CS UI"
I take it this means the host needs to be in a Xen pool first, but I don't know what the pool referenced by <UUID> is. It does not match the cluster UUID in Cloudstack, or any pool UUID's that I can see in Xen. I see that there is a xe pool-join command, but it takes an IP address, not a UUID. How do I join my host to the pool given by the Cloudstack error message above?
-----Original Message-----
From: Abhinandan Prateek [mailto:abhinandan.prateek@shapeblue.com]
Sent: Tuesday, January 27, 2015 9:56 PM
To: users@cloudstack.apache.org
Subject: Re: Removing a host from a cluster and adding it to another
The tag needs to be removed from the Xen Hypervisor so that it cleanly goes to another cluster. Use the following to clear host tags after detaching it from the pool:
xe host-param-clear uuid=$host param-name=tags; (Run it in moving Xen host)
You also need to clear the SR on this host so that there is no conflict when it is added to another cluster. Following are the steps to clear the SR:
[root@xenserver1-cloudstack ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
.....
172.16.197.134:/opt/storage/primary
19856384 2560128 16300160 14% /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a
[root@xenserver1-cloudstack ~]# xe pbd-list sr-uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
uuid ( RO) : 2e2aced7-f27f-917f-a017-68f3504967f0
..
[root@xenserver1-cloudstack ~]# xe pbd-unplug uuid=2e2aced7-f27f-917f-a017-68f3504967f0
[root@xenserver1-cloudstack ~]# xe sr-forget uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
# for pbd in `xe pbd-list currently-attached=false| grep ^uuid | awk '{print $NF}'`; do xe pbd-plug uuid=$pbd ; done
Regards,
Abhinandan Prateek
M +919701199011
abhinandan.prateek@shapeblue.com
> On 28-Jan-2015, at 9:49 am, Kyle Flavin <ky...@citrix.com> wrote:
>
> Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
>
> select * from host_tags where host_id=<host_id>;
>
> +-----+---------+----------------+
> | id | host_id | tag |
> +-----+---------+----------------+
> | <id> | <hosted> | <host_name> |
> +-----+---------+----------------+
>
> Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
>
> -----Original Message-----
> From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
> Sent: Tuesday, January 27, 2015 5:20 PM
> To: users@cloudstack.apache.org
> Subject: RE: Removing a host from a cluster and adding it to another
>
> Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
>
> Regards,
> Somesh
>
>
> -----Original Message-----
> From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
> Sent: Tuesday, January 27, 2015 7:50 PM
> To: users@cloudstack.apache.org
> Subject: Removing a host from a cluster and adding it to another
>
> I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
>
> Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
>
> 2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
>
> On the Xen host itself, I see the following in the xensource.log:
>
> Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
>
> It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
>
> Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
>
> Thanks,
> Kyle
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Removing a host from a cluster and adding it to another
Posted by Kyle Flavin <ky...@citrix.com>.
Unfortunately, I'm still running into issues adding my Xen host to the Cloudstack cluster, even after reinstalling the host. When I attempt to add the new host, I get a "Failed to add host" message in the web UI. As before, xensource.log doesn't show any errors other than this:
/opt/xensource/bin/xapi: [debug|<hostnameremoved>|620 INET 0.0.0.0:80|pool_patch.get_by_uuid D:b910526acfa9|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID:
I feel like I'm probably missing something obvious, but I haven't been able to figure out what.
I'm following the Cloudstack installation Guide for Xenserver, as well as the Xenserver 6.2 Installation Guide (PDF):
http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/latest/hypervisor/xenserver.html
I did the following:
- Reinstalled Xenserver from scratch.
- Attached to the host from XenCenter, and created a new pool and added the host (it's the only host in the pool)
- Went into the Cloudstack WebUI and created a new Cluster (this cluster exists in the same pod as the old cluster)
- Tried to add the host, and received the failure message
One thing I did notice (prior to rebuilding) is that I was able to re-add the host back into to the original cluster it had been a part of. I just could not add it to the new cluster (I haven't tried again with the fresh install just yet, because the install took 2.5 hours, and I want to investigate other possibilities). So I'm wondering if there are some artifacts being left in Cloudstack that are preventing me from adding the host to the new cluster? I reused the hostname, so it seems like it might make sense that it could be an issue. I do still see references in the database to the hostname in the "host" table, although it's shown as "removed".
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: Wednesday, January 28, 2015 9:46 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Got it. Option #1 is probably what I'll end up doing eventually. But I'm hesitant to do that on my first try on a cluster with running VM's. I'd like to see the upgrade process first.
I think I'll start by creating a one node cluster as planned, just to see the upgrade process. Then I'll circle back and attempt option #1 on the existing cluster. Actually, there are multiple clusters running 6.2, so it makes sense to do them in place once I can get a process in order.
Thanks for your help.
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Wednesday, January 28, 2015 9:33 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Kyle,
If your main goal was to upgrade the Cluster to XenServer 6.5 you have two options.
1. Upgrade the cluster in-situ, and you can use this guide to help you http://shapeblue.com/citrix/how-to-upgrade-an-apache-cloudstack-citrix-xenserver-cluster/
2. Build a new Cluster with cleanly installed Hosts and then live migrate the VMs into the new Cluster
Option 1 does not involve taking hosts out of the Cluster, the key is to upgrade the Pool Master (and only the pool master) first, then upgrade remaining hosts one at a time.
For option 2 you need to ensure each Cluster has 3 Hosts before you put any Client VMs on them as running Clusters with less than three Hosts in production is definitely not recommended.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 17:20
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Hi Geoff,
So question for you. The purpose behind me doing this is to test upgrade a single host from Xen 6.2 to 6.5. I was moving the host out of its original cluster so as not to impact any running VM's in the existing cluster (I haven't attempted to upgrade XenServer before, so I want to be extra careful). Does that approach makes sense to you? Given the time I've sunk into this over the past day, I'm thinking I may reinstall with Xen 6.2, add it to its own CS cluster, and then attempt the upgrade to 6.5.
Kyle
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Wednesday, January 28, 2015 9:04 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Kyle,
I'm guessing there is still something referencing the old Pool the Host used to belong to which is causing the problem.
I really recommend you just re-install XenServer from scratch and have a clean host.
A XenServer 6.5 install takes literally 10 mins to do a manual install as there are no Hotfixes to apply yet, a XenServer 6.2 install can take an hour due to all the Hotfixes but you only need to apply the following as they contain all the others not listed:
XS62ESP1.xsupdate
XS62ESP1003.xsupdate
XS62ESP1005.xsupdate
XS62ESP1009.xsupdate
XS62ESP1014.xsupdate
XS62ESP1016.xsupdate
So that would be six reboots of the host to apply all the patches up to XS62ESP1016
I also recommend you invest some time setting up a PXE deployment architecture which can auto install XenServer and all the patches, then if you ever need to re-install a host or deploy a new one, you can do so with very little effort and enjoy a nice hot coffee while it does all the work for you.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 16:50
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
I seem to be a little closer. I've cleared the tags and the SR on my host. When I try to add the host to my new cluster through the Cloudstack web UI, I now see this:
"Please join the host <IP> to XS pool <UUID> through XC/XS before adding it through CS UI"
I take it this means the host needs to be in a Xen pool first, but I don't know what the pool referenced by <UUID> is. It does not match the cluster UUID in Cloudstack, or any pool UUID's that I can see in Xen. I see that there is a xe pool-join command, but it takes an IP address, not a UUID. How do I join my host to the pool given by the Cloudstack error message above?
-----Original Message-----
From: Abhinandan Prateek [mailto:abhinandan.prateek@shapeblue.com]
Sent: Tuesday, January 27, 2015 9:56 PM
To: users@cloudstack.apache.org
Subject: Re: Removing a host from a cluster and adding it to another
The tag needs to be removed from the Xen Hypervisor so that it cleanly goes to another cluster. Use the following to clear host tags after detaching it from the pool:
xe host-param-clear uuid=$host param-name=tags; (Run it in moving Xen host)
You also need to clear the SR on this host so that there is no conflict when it is added to another cluster. Following are the steps to clear the SR:
[root@xenserver1-cloudstack ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
.....
172.16.197.134:/opt/storage/primary
19856384 2560128 16300160 14% /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a
[root@xenserver1-cloudstack ~]# xe pbd-list sr-uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
uuid ( RO) : 2e2aced7-f27f-917f-a017-68f3504967f0
..
[root@xenserver1-cloudstack ~]# xe pbd-unplug uuid=2e2aced7-f27f-917f-a017-68f3504967f0
[root@xenserver1-cloudstack ~]# xe sr-forget uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
# for pbd in `xe pbd-list currently-attached=false| grep ^uuid | awk '{print $NF}'`; do xe pbd-plug uuid=$pbd ; done
Regards,
Abhinandan Prateek
M +919701199011
abhinandan.prateek@shapeblue.com
> On 28-Jan-2015, at 9:49 am, Kyle Flavin <ky...@citrix.com> wrote:
>
> Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
>
> select * from host_tags where host_id=<host_id>;
>
> +-----+---------+----------------+
> | id | host_id | tag |
> +-----+---------+----------------+
> | <id> | <hosted> | <host_name> |
> +-----+---------+----------------+
>
> Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
>
> -----Original Message-----
> From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
> Sent: Tuesday, January 27, 2015 5:20 PM
> To: users@cloudstack.apache.org
> Subject: RE: Removing a host from a cluster and adding it to another
>
> Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
>
> Regards,
> Somesh
>
>
> -----Original Message-----
> From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
> Sent: Tuesday, January 27, 2015 7:50 PM
> To: users@cloudstack.apache.org
> Subject: Removing a host from a cluster and adding it to another
>
> I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
>
> Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
>
> 2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
>
> On the Xen host itself, I see the following in the xensource.log:
>
> Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
>
> It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
>
> Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
>
> Thanks,
> Kyle
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Removing a host from a cluster and adding it to another
Posted by Kyle Flavin <ky...@citrix.com>.
Got it. Option #1 is probably what I'll end up doing eventually. But I'm hesitant to do that on my first try on a cluster with running VM's. I'd like to see the upgrade process first.
I think I'll start by creating a one node cluster as planned, just to see the upgrade process. Then I'll circle back and attempt option #1 on the existing cluster. Actually, there are multiple clusters running 6.2, so it makes sense to do them in place once I can get a process in order.
Thanks for your help.
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Wednesday, January 28, 2015 9:33 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Kyle,
If your main goal was to upgrade the Cluster to XenServer 6.5 you have two options.
1. Upgrade the cluster in-situ, and you can use this guide to help you http://shapeblue.com/citrix/how-to-upgrade-an-apache-cloudstack-citrix-xenserver-cluster/
2. Build a new Cluster with cleanly installed Hosts and then live migrate the VMs into the new Cluster
Option 1 does not involve taking hosts out of the Cluster, the key is to upgrade the Pool Master (and only the pool master) first, then upgrade remaining hosts one at a time.
For option 2 you need to ensure each Cluster has 3 Hosts before you put any Client VMs on them as running Clusters with less than three Hosts in production is definitely not recommended.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 17:20
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Hi Geoff,
So question for you. The purpose behind me doing this is to test upgrade a single host from Xen 6.2 to 6.5. I was moving the host out of its original cluster so as not to impact any running VM's in the existing cluster (I haven't attempted to upgrade XenServer before, so I want to be extra careful). Does that approach makes sense to you? Given the time I've sunk into this over the past day, I'm thinking I may reinstall with Xen 6.2, add it to its own CS cluster, and then attempt the upgrade to 6.5.
Kyle
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Wednesday, January 28, 2015 9:04 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Kyle,
I'm guessing there is still something referencing the old Pool the Host used to belong to which is causing the problem.
I really recommend you just re-install XenServer from scratch and have a clean host.
A XenServer 6.5 install takes literally 10 mins to do a manual install as there are no Hotfixes to apply yet, a XenServer 6.2 install can take an hour due to all the Hotfixes but you only need to apply the following as they contain all the others not listed:
XS62ESP1.xsupdate
XS62ESP1003.xsupdate
XS62ESP1005.xsupdate
XS62ESP1009.xsupdate
XS62ESP1014.xsupdate
XS62ESP1016.xsupdate
So that would be six reboots of the host to apply all the patches up to XS62ESP1016
I also recommend you invest some time setting up a PXE deployment architecture which can auto install XenServer and all the patches, then if you ever need to re-install a host or deploy a new one, you can do so with very little effort and enjoy a nice hot coffee while it does all the work for you.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 16:50
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
I seem to be a little closer. I've cleared the tags and the SR on my host. When I try to add the host to my new cluster through the Cloudstack web UI, I now see this:
"Please join the host <IP> to XS pool <UUID> through XC/XS before adding it through CS UI"
I take it this means the host needs to be in a Xen pool first, but I don't know what the pool referenced by <UUID> is. It does not match the cluster UUID in Cloudstack, or any pool UUID's that I can see in Xen. I see that there is a xe pool-join command, but it takes an IP address, not a UUID. How do I join my host to the pool given by the Cloudstack error message above?
-----Original Message-----
From: Abhinandan Prateek [mailto:abhinandan.prateek@shapeblue.com]
Sent: Tuesday, January 27, 2015 9:56 PM
To: users@cloudstack.apache.org
Subject: Re: Removing a host from a cluster and adding it to another
The tag needs to be removed from the Xen Hypervisor so that it cleanly goes to another cluster. Use the following to clear host tags after detaching it from the pool:
xe host-param-clear uuid=$host param-name=tags; (Run it in moving Xen host)
You also need to clear the SR on this host so that there is no conflict when it is added to another cluster. Following are the steps to clear the SR:
[root@xenserver1-cloudstack ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
.....
172.16.197.134:/opt/storage/primary
19856384 2560128 16300160 14% /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a
[root@xenserver1-cloudstack ~]# xe pbd-list sr-uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
uuid ( RO) : 2e2aced7-f27f-917f-a017-68f3504967f0
..
[root@xenserver1-cloudstack ~]# xe pbd-unplug uuid=2e2aced7-f27f-917f-a017-68f3504967f0
[root@xenserver1-cloudstack ~]# xe sr-forget uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
# for pbd in `xe pbd-list currently-attached=false| grep ^uuid | awk '{print $NF}'`; do xe pbd-plug uuid=$pbd ; done
Regards,
Abhinandan Prateek
M +919701199011
abhinandan.prateek@shapeblue.com
> On 28-Jan-2015, at 9:49 am, Kyle Flavin <ky...@citrix.com> wrote:
>
> Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
>
> select * from host_tags where host_id=<host_id>;
>
> +-----+---------+----------------+
> | id | host_id | tag |
> +-----+---------+----------------+
> | <id> | <hosted> | <host_name> |
> +-----+---------+----------------+
>
> Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
>
> -----Original Message-----
> From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
> Sent: Tuesday, January 27, 2015 5:20 PM
> To: users@cloudstack.apache.org
> Subject: RE: Removing a host from a cluster and adding it to another
>
> Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
>
> Regards,
> Somesh
>
>
> -----Original Message-----
> From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
> Sent: Tuesday, January 27, 2015 7:50 PM
> To: users@cloudstack.apache.org
> Subject: Removing a host from a cluster and adding it to another
>
> I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
>
> Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
>
> 2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
>
> On the Xen host itself, I see the following in the xensource.log:
>
> Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
>
> It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
>
> Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
>
> Thanks,
> Kyle
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Removing a host from a cluster and adding it to another
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Kyle,
If your main goal was to upgrade the Cluster to XenServer 6.5 you have two options.
1. Upgrade the cluster in-situ, and you can use this guide to help you http://shapeblue.com/citrix/how-to-upgrade-an-apache-cloudstack-citrix-xenserver-cluster/
2. Build a new Cluster with cleanly installed Hosts and then live migrate the VMs into the new Cluster
Option 1 does not involve taking hosts out of the Cluster, the key is to upgrade the Pool Master (and only the pool master) first, then upgrade remaining hosts one at a time.
For option 2 you need to ensure each Cluster has 3 Hosts before you put any Client VMs on them as running Clusters with less than three Hosts in production is definitely not recommended.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 17:20
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Hi Geoff,
So question for you. The purpose behind me doing this is to test upgrade a single host from Xen 6.2 to 6.5. I was moving the host out of its original cluster so as not to impact any running VM's in the existing cluster (I haven't attempted to upgrade XenServer before, so I want to be extra careful). Does that approach makes sense to you? Given the time I've sunk into this over the past day, I'm thinking I may reinstall with Xen 6.2, add it to its own CS cluster, and then attempt the upgrade to 6.5.
Kyle
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Wednesday, January 28, 2015 9:04 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Kyle,
I'm guessing there is still something referencing the old Pool the Host used to belong to which is causing the problem.
I really recommend you just re-install XenServer from scratch and have a clean host.
A XenServer 6.5 install takes literally 10 mins to do a manual install as there are no Hotfixes to apply yet, a XenServer 6.2 install can take an hour due to all the Hotfixes but you only need to apply the following as they contain all the others not listed:
XS62ESP1.xsupdate
XS62ESP1003.xsupdate
XS62ESP1005.xsupdate
XS62ESP1009.xsupdate
XS62ESP1014.xsupdate
XS62ESP1016.xsupdate
So that would be six reboots of the host to apply all the patches up to XS62ESP1016
I also recommend you invest some time setting up a PXE deployment architecture which can auto install XenServer and all the patches, then if you ever need to re-install a host or deploy a new one, you can do so with very little effort and enjoy a nice hot coffee while it does all the work for you.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 16:50
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
I seem to be a little closer. I've cleared the tags and the SR on my host. When I try to add the host to my new cluster through the Cloudstack web UI, I now see this:
"Please join the host <IP> to XS pool <UUID> through XC/XS before adding it through CS UI"
I take it this means the host needs to be in a Xen pool first, but I don't know what the pool referenced by <UUID> is. It does not match the cluster UUID in Cloudstack, or any pool UUID's that I can see in Xen. I see that there is a xe pool-join command, but it takes an IP address, not a UUID. How do I join my host to the pool given by the Cloudstack error message above?
-----Original Message-----
From: Abhinandan Prateek [mailto:abhinandan.prateek@shapeblue.com]
Sent: Tuesday, January 27, 2015 9:56 PM
To: users@cloudstack.apache.org
Subject: Re: Removing a host from a cluster and adding it to another
The tag needs to be removed from the Xen Hypervisor so that it cleanly goes to another cluster. Use the following to clear host tags after detaching it from the pool:
xe host-param-clear uuid=$host param-name=tags; (Run it in moving Xen host)
You also need to clear the SR on this host so that there is no conflict when it is added to another cluster. Following are the steps to clear the SR:
[root@xenserver1-cloudstack ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
.....
172.16.197.134:/opt/storage/primary
19856384 2560128 16300160 14% /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a
[root@xenserver1-cloudstack ~]# xe pbd-list sr-uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
uuid ( RO) : 2e2aced7-f27f-917f-a017-68f3504967f0
..
[root@xenserver1-cloudstack ~]# xe pbd-unplug uuid=2e2aced7-f27f-917f-a017-68f3504967f0
[root@xenserver1-cloudstack ~]# xe sr-forget uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
# for pbd in `xe pbd-list currently-attached=false| grep ^uuid | awk '{print $NF}'`; do xe pbd-plug uuid=$pbd ; done
Regards,
Abhinandan Prateek
M +919701199011
abhinandan.prateek@shapeblue.com
> On 28-Jan-2015, at 9:49 am, Kyle Flavin <ky...@citrix.com> wrote:
>
> Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
>
> select * from host_tags where host_id=<host_id>;
>
> +-----+---------+----------------+
> | id | host_id | tag |
> +-----+---------+----------------+
> | <id> | <hosted> | <host_name> |
> +-----+---------+----------------+
>
> Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
>
> -----Original Message-----
> From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
> Sent: Tuesday, January 27, 2015 5:20 PM
> To: users@cloudstack.apache.org
> Subject: RE: Removing a host from a cluster and adding it to another
>
> Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
>
> Regards,
> Somesh
>
>
> -----Original Message-----
> From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
> Sent: Tuesday, January 27, 2015 7:50 PM
> To: users@cloudstack.apache.org
> Subject: Removing a host from a cluster and adding it to another
>
> I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
>
> Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
>
> 2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
>
> On the Xen host itself, I see the following in the xensource.log:
>
> Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
>
> It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
>
> Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
>
> Thanks,
> Kyle
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Removing a host from a cluster and adding it to another
Posted by Kyle Flavin <ky...@citrix.com>.
Hi Geoff,
So question for you. The purpose behind me doing this is to test upgrade a single host from Xen 6.2 to 6.5. I was moving the host out of its original cluster so as not to impact any running VM's in the existing cluster (I haven't attempted to upgrade XenServer before, so I want to be extra careful). Does that approach makes sense to you? Given the time I've sunk into this over the past day, I'm thinking I may reinstall with Xen 6.2, add it to its own CS cluster, and then attempt the upgrade to 6.5.
Kyle
-----Original Message-----
From: Geoff Higginbottom [mailto:geoff.higginbottom@shapeblue.com]
Sent: Wednesday, January 28, 2015 9:04 AM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Kyle,
I'm guessing there is still something referencing the old Pool the Host used to belong to which is causing the problem.
I really recommend you just re-install XenServer from scratch and have a clean host.
A XenServer 6.5 install takes literally 10 mins to do a manual install as there are no Hotfixes to apply yet, a XenServer 6.2 install can take an hour due to all the Hotfixes but you only need to apply the following as they contain all the others not listed:
XS62ESP1.xsupdate
XS62ESP1003.xsupdate
XS62ESP1005.xsupdate
XS62ESP1009.xsupdate
XS62ESP1014.xsupdate
XS62ESP1016.xsupdate
So that would be six reboots of the host to apply all the patches up to XS62ESP1016
I also recommend you invest some time setting up a PXE deployment architecture which can auto install XenServer and all the patches, then if you ever need to re-install a host or deploy a new one, you can do so with very little effort and enjoy a nice hot coffee while it does all the work for you.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 16:50
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
I seem to be a little closer. I've cleared the tags and the SR on my host. When I try to add the host to my new cluster through the Cloudstack web UI, I now see this:
"Please join the host <IP> to XS pool <UUID> through XC/XS before adding it through CS UI"
I take it this means the host needs to be in a Xen pool first, but I don't know what the pool referenced by <UUID> is. It does not match the cluster UUID in Cloudstack, or any pool UUID's that I can see in Xen. I see that there is a xe pool-join command, but it takes an IP address, not a UUID. How do I join my host to the pool given by the Cloudstack error message above?
-----Original Message-----
From: Abhinandan Prateek [mailto:abhinandan.prateek@shapeblue.com]
Sent: Tuesday, January 27, 2015 9:56 PM
To: users@cloudstack.apache.org
Subject: Re: Removing a host from a cluster and adding it to another
The tag needs to be removed from the Xen Hypervisor so that it cleanly goes to another cluster. Use the following to clear host tags after detaching it from the pool:
xe host-param-clear uuid=$host param-name=tags; (Run it in moving Xen host)
You also need to clear the SR on this host so that there is no conflict when it is added to another cluster. Following are the steps to clear the SR:
[root@xenserver1-cloudstack ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
.....
172.16.197.134:/opt/storage/primary
19856384 2560128 16300160 14% /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a
[root@xenserver1-cloudstack ~]# xe pbd-list sr-uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
uuid ( RO) : 2e2aced7-f27f-917f-a017-68f3504967f0
..
[root@xenserver1-cloudstack ~]# xe pbd-unplug uuid=2e2aced7-f27f-917f-a017-68f3504967f0
[root@xenserver1-cloudstack ~]# xe sr-forget uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
# for pbd in `xe pbd-list currently-attached=false| grep ^uuid | awk '{print $NF}'`; do xe pbd-plug uuid=$pbd ; done
Regards,
Abhinandan Prateek
M +919701199011
abhinandan.prateek@shapeblue.com
> On 28-Jan-2015, at 9:49 am, Kyle Flavin <ky...@citrix.com> wrote:
>
> Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
>
> select * from host_tags where host_id=<host_id>;
>
> +-----+---------+----------------+
> | id | host_id | tag |
> +-----+---------+----------------+
> | <id> | <hosted> | <host_name> |
> +-----+---------+----------------+
>
> Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
>
> -----Original Message-----
> From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
> Sent: Tuesday, January 27, 2015 5:20 PM
> To: users@cloudstack.apache.org
> Subject: RE: Removing a host from a cluster and adding it to another
>
> Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
>
> Regards,
> Somesh
>
>
> -----Original Message-----
> From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
> Sent: Tuesday, January 27, 2015 7:50 PM
> To: users@cloudstack.apache.org
> Subject: Removing a host from a cluster and adding it to another
>
> I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
>
> Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
>
> 2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
>
> On the Xen host itself, I see the following in the xensource.log:
>
> Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
>
> It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
>
> Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
>
> Thanks,
> Kyle
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Removing a host from a cluster and adding it to another
Posted by Geoff Higginbottom <ge...@shapeblue.com>.
Kyle,
I'm guessing there is still something referencing the old Pool the Host used to belong to which is causing the problem.
I really recommend you just re-install XenServer from scratch and have a clean host.
A XenServer 6.5 install takes literally 10 mins to do a manual install as there are no Hotfixes to apply yet, a XenServer 6.2 install can take an hour due to all the Hotfixes but you only need to apply the following as they contain all the others not listed:
XS62ESP1.xsupdate
XS62ESP1003.xsupdate
XS62ESP1005.xsupdate
XS62ESP1009.xsupdate
XS62ESP1014.xsupdate
XS62ESP1016.xsupdate
So that would be six reboots of the host to apply all the patches up to XS62ESP1016
I also recommend you invest some time setting up a PXE deployment architecture which can auto install XenServer and all the patches, then if you ever need to re-install a host or deploy a new one, you can do so with very little effort and enjoy a nice hot coffee while it does all the work for you.
Regards
Geoff Higginbottom
D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581
geoff.higginbottom@shapeblue.com
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: 28 January 2015 16:50
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
I seem to be a little closer. I've cleared the tags and the SR on my host. When I try to add the host to my new cluster through the Cloudstack web UI, I now see this:
"Please join the host <IP> to XS pool <UUID> through XC/XS before adding it through CS UI"
I take it this means the host needs to be in a Xen pool first, but I don't know what the pool referenced by <UUID> is. It does not match the cluster UUID in Cloudstack, or any pool UUID's that I can see in Xen. I see that there is a xe pool-join command, but it takes an IP address, not a UUID. How do I join my host to the pool given by the Cloudstack error message above?
-----Original Message-----
From: Abhinandan Prateek [mailto:abhinandan.prateek@shapeblue.com]
Sent: Tuesday, January 27, 2015 9:56 PM
To: users@cloudstack.apache.org
Subject: Re: Removing a host from a cluster and adding it to another
The tag needs to be removed from the Xen Hypervisor so that it cleanly goes to another cluster. Use the following to clear host tags after detaching it from the pool:
xe host-param-clear uuid=$host param-name=tags; (Run it in moving Xen host)
You also need to clear the SR on this host so that there is no conflict when it is added to another cluster. Following are the steps to clear the SR:
[root@xenserver1-cloudstack ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
.....
172.16.197.134:/opt/storage/primary
19856384 2560128 16300160 14% /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a
[root@xenserver1-cloudstack ~]# xe pbd-list sr-uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
uuid ( RO) : 2e2aced7-f27f-917f-a017-68f3504967f0
..
[root@xenserver1-cloudstack ~]# xe pbd-unplug uuid=2e2aced7-f27f-917f-a017-68f3504967f0
[root@xenserver1-cloudstack ~]# xe sr-forget uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
# for pbd in `xe pbd-list currently-attached=false| grep ^uuid | awk '{print $NF}'`; do xe pbd-plug uuid=$pbd ; done
Regards,
Abhinandan Prateek
M +919701199011
abhinandan.prateek@shapeblue.com
> On 28-Jan-2015, at 9:49 am, Kyle Flavin <ky...@citrix.com> wrote:
>
> Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
>
> select * from host_tags where host_id=<host_id>;
>
> +-----+---------+----------------+
> | id | host_id | tag |
> +-----+---------+----------------+
> | <id> | <hosted> | <host_name> |
> +-----+---------+----------------+
>
> Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
>
> -----Original Message-----
> From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
> Sent: Tuesday, January 27, 2015 5:20 PM
> To: users@cloudstack.apache.org
> Subject: RE: Removing a host from a cluster and adding it to another
>
> Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
>
> Regards,
> Somesh
>
>
> -----Original Message-----
> From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
> Sent: Tuesday, January 27, 2015 7:50 PM
> To: users@cloudstack.apache.org
> Subject: Removing a host from a cluster and adding it to another
>
> I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
>
> Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
>
> 2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
>
> On the Xen host itself, I see the following in the xensource.log:
>
> Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
>
> It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
>
> Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
>
> Thanks,
> Kyle
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Removing a host from a cluster and adding it to another
Posted by Kyle Flavin <ky...@citrix.com>.
I seem to be a little closer. I've cleared the tags and the SR on my host. When I try to add the host to my new cluster through the Cloudstack web UI, I now see this:
"Please join the host <IP> to XS pool <UUID> through XC/XS before adding it through CS UI"
I take it this means the host needs to be in a Xen pool first, but I don't know what the pool referenced by <UUID> is. It does not match the cluster UUID in Cloudstack, or any pool UUID's that I can see in Xen. I see that there is a xe pool-join command, but it takes an IP address, not a UUID. How do I join my host to the pool given by the Cloudstack error message above?
-----Original Message-----
From: Abhinandan Prateek [mailto:abhinandan.prateek@shapeblue.com]
Sent: Tuesday, January 27, 2015 9:56 PM
To: users@cloudstack.apache.org
Subject: Re: Removing a host from a cluster and adding it to another
The tag needs to be removed from the Xen Hypervisor so that it cleanly goes to another cluster. Use the following to clear host tags after detaching it from the pool:
xe host-param-clear uuid=$host param-name=tags; (Run it in moving Xen host)
You also need to clear the SR on this host so that there is no conflict when it is added to another cluster. Following are the steps to clear the SR:
[root@xenserver1-cloudstack ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
.....
172.16.197.134:/opt/storage/primary
19856384 2560128 16300160 14% /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a
[root@xenserver1-cloudstack ~]# xe pbd-list sr-uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
uuid ( RO) : 2e2aced7-f27f-917f-a017-68f3504967f0
..
[root@xenserver1-cloudstack ~]# xe pbd-unplug uuid=2e2aced7-f27f-917f-a017-68f3504967f0
[root@xenserver1-cloudstack ~]# xe sr-forget uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
# for pbd in `xe pbd-list currently-attached=false| grep ^uuid | awk '{print $NF}'`; do xe pbd-plug uuid=$pbd ; done
Regards,
Abhinandan Prateek
M +919701199011
abhinandan.prateek@shapeblue.com
> On 28-Jan-2015, at 9:49 am, Kyle Flavin <ky...@citrix.com> wrote:
>
> Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
>
> select * from host_tags where host_id=<host_id>;
>
> +-----+---------+----------------+
> | id | host_id | tag |
> +-----+---------+----------------+
> | <id> | <hosted> | <host_name> |
> +-----+---------+----------------+
>
> Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
>
> -----Original Message-----
> From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
> Sent: Tuesday, January 27, 2015 5:20 PM
> To: users@cloudstack.apache.org
> Subject: RE: Removing a host from a cluster and adding it to another
>
> Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
>
> Regards,
> Somesh
>
>
> -----Original Message-----
> From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
> Sent: Tuesday, January 27, 2015 7:50 PM
> To: users@cloudstack.apache.org
> Subject: Removing a host from a cluster and adding it to another
>
> I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
>
> Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
>
> 2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
>
> On the Xen host itself, I see the following in the xensource.log:
>
> Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
>
> It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
>
> Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
>
> Thanks,
> Kyle
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
Re: Removing a host from a cluster and adding it to another
Posted by Abhinandan Prateek <ab...@shapeblue.com>.
The tag needs to be removed from the Xen Hypervisor so that it cleanly goes to another cluster. Use the following to clear host tags after detaching it from the pool:
xe host-param-clear uuid=$host param-name=tags; (Run it in moving Xen host)
You also need to clear the SR on this host so that there is no conflict when it is added to another cluster. Following are the steps to clear the SR:
[root@xenserver1-cloudstack ~]# df
Filesystem 1K-blocks Used Available Use% Mounted on
.....
172.16.197.134:/opt/storage/primary
19856384 2560128 16300160 14% /var/run/sr-mount/66f0805b-da95-872c-2a6e-d5c46c219c2a
[root@xenserver1-cloudstack ~]# xe pbd-list sr-uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
uuid ( RO) : 2e2aced7-f27f-917f-a017-68f3504967f0
..
[root@xenserver1-cloudstack ~]# xe pbd-unplug uuid=2e2aced7-f27f-917f-a017-68f3504967f0
[root@xenserver1-cloudstack ~]# xe sr-forget uuid=66f0805b-da95-872c-2a6e-d5c46c219c2a
# for pbd in `xe pbd-list currently-attached=false| grep ^uuid | awk '{print $NF}'`; do xe pbd-plug uuid=$pbd ; done
Regards,
Abhinandan Prateek
M +919701199011
abhinandan.prateek@shapeblue.com
> On 28-Jan-2015, at 9:49 am, Kyle Flavin <ky...@citrix.com> wrote:
>
> Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
>
> select * from host_tags where host_id=<host_id>;
>
> +-----+---------+----------------+
> | id | host_id | tag |
> +-----+---------+----------------+
> | <id> | <hosted> | <host_name> |
> +-----+---------+----------------+
>
> Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
>
> -----Original Message-----
> From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
> Sent: Tuesday, January 27, 2015 5:20 PM
> To: users@cloudstack.apache.org
> Subject: RE: Removing a host from a cluster and adding it to another
>
> Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
>
> Regards,
> Somesh
>
>
> -----Original Message-----
> From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
> Sent: Tuesday, January 27, 2015 7:50 PM
> To: users@cloudstack.apache.org
> Subject: Removing a host from a cluster and adding it to another
>
> I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
>
> Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
>
> 2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
>
> On the Xen host itself, I see the following in the xensource.log:
>
> Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
>
> It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
>
> Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
>
> Thanks,
> Kyle
Find out more about ShapeBlue and our range of CloudStack related services
IaaS Cloud Design & Build<http://shapeblue.com/iaas-cloud-design-and-build//>
CSForge – rapid IaaS deployment framework<http://shapeblue.com/csforge/>
CloudStack Consulting<http://shapeblue.com/cloudstack-consultancy/>
CloudStack Software Engineering<http://shapeblue.com/cloudstack-software-engineering/>
CloudStack Infrastructure Support<http://shapeblue.com/cloudstack-infrastructure-support/>
CloudStack Bootcamp Training Courses<http://shapeblue.com/cloudstack-training/>
This email and any attachments to it may be confidential and are intended solely for the use of the individual to whom it is addressed. Any views or opinions expressed are solely those of the author and do not necessarily represent those of Shape Blue Ltd or related companies. If you are not the intended recipient of this email, you must neither take any action based upon its contents, nor copy or show it to anyone. Please contact the sender if you believe you have received this email in error. Shape Blue Ltd is a company incorporated in England & Wales. ShapeBlue Services India LLP is a company incorporated in India and is operated under license from Shape Blue Ltd. Shape Blue Brasil Consultoria Ltda is a company incorporated in Brasil and is operated under license from Shape Blue Ltd. ShapeBlue SA Pty Ltd is a company registered by The Republic of South Africa and is traded under license from Shape Blue Ltd. ShapeBlue is a registered trademark.
RE: Removing a host from a cluster and adding it to another
Posted by Kyle Flavin <ky...@citrix.com>.
Ah, yes I can confirm that there is a host tag with the following query on the CS database. Here is the sanitized output from the host_tags table:
select * from host_tags where host_id=<host_id>;
+-----+---------+----------------+
| id | host_id | tag |
+-----+---------+----------------+
| <id> | <hosted> | <host_name> |
+-----+---------+----------------+
Is it safe to delete this entry, or should I add the host back into its old cluster and then delete the tag through the UI?
-----Original Message-----
From: Somesh Naidu [mailto:Somesh.Naidu@citrix.com]
Sent: Tuesday, January 27, 2015 5:20 PM
To: users@cloudstack.apache.org
Subject: RE: Removing a host from a cluster and adding it to another
Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
Regards,
Somesh
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: Tuesday, January 27, 2015 7:50 PM
To: users@cloudstack.apache.org
Subject: Removing a host from a cluster and adding it to another
I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
On the Xen host itself, I see the following in the xensource.log:
Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
Thanks,
Kyle
RE: Removing a host from a cluster and adding it to another
Posted by Somesh Naidu <So...@citrix.com>.
Yes, check what's in the "tags" parameter of that host. Cleaning it should resolve the issue.
Regards,
Somesh
-----Original Message-----
From: Kyle Flavin [mailto:kyle.flavin@citrix.com]
Sent: Tuesday, January 27, 2015 7:50 PM
To: users@cloudstack.apache.org
Subject: Removing a host from a cluster and adding it to another
I've removed a host from one Cloudstack cluster, and I'm attempting to add it to a new cluster. It will be the only host in the cluster, and used for testing purposes. I put the host into maintenance mode, removed it from its original cluster within the Cloudstack UI, then deleted it from the Xen pool using xe pool-eject.
Now when I create a new cluster, and try to add the host, I get an error message that just says "Unable to add host" from within the Cloudstack web UI. I see messages in management-server.log that say "Trying to add a new host at http://<myhost<http://%3cmyhost>>", but no indication of an error:
2015-01-27 16:28:31,142 INFO [c.c.r.ResourceManagerImpl] (catalina-exec-13:ctx-4ab1a388 ctx-fa2957ea) Trying to add a new host at http://<myhost> in data center 1
On the Xen host itself, I see the following in the xensource.log:
Jan 28 00:28:31 <host> t1 /opt/xensource/bin/xapi: [debug|<host>|748 INET 0.0.0.0:80|pool_patch.get_by_uuid D:5fb0d4d944bb|dispatcher] Server_helpers.exec exception_handler: Got exception UUID_INVALID: [ pool_patch; 996dd2e7-ad95-49cc-a0be-2c9adc4dfb0b ]
It references an invalid ID, but I'm not sure what that UUID belongs to; it isn't the UUID of the pool.
Is there something that needs to be done to "clear" the configuration of a Xenserver host prior to adding it to a new cluster? Or is Cloudstack "remembering" the old host name and not allowing me to put it into the new cluster?
Thanks,
Kyle