You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Muhammad Adeel Zahid <16...@lums.edu.pk> on 2017/10/19 08:00:19 UTC

My server running Cloudstack-management fails to shutdown properly

Hello,


I am running cloudstack on Cent OS 6 server. When I try to shut down this machine, it hangs. It fails to stop the cloudstack-management but it surpasses this point. Furthermore, during shutdown, machine hangs with this message


Unmounting NFS filesystem: unmount.nfs: /mnt/some-long-uuid: device is busy


After showing above message, it hangs and I have to power off the system.


How can I get around this problem.


Regards

Adeel


Re: My server running Cloudstack-management fails to shutdown properly

Posted by Muhammad Adeel Zahid <16...@lums.edu.pk>.
I faced too many problems when trying to delete the a zone and adding new one.

For deleting zone-1

I was able to successfully delete instances hosts, cluster, pod and region but I was not able to delete primary and secondary storage for the zone. When I tried deleting secondary storage, it tells me I can't do so because there are templates. When I try to delete templates, I get error message, "Failed to delete template/ISO". I saw in log files that this is because no system VM is running which is correct.


Adding Zone 2:

I added zone, region, pod, cluster, primary and secondary storage and one host. But now system vm is running probably because I get error when CS tries to run system vm for zone-1.


I am currently not able to find how to fix this


Regards

Adeel

________________________________
From: Muhammad Adeel Zahid
Sent: Thursday, October 19, 2017 3:41:45 PM
To: users@cloudstack.apache.org
Subject: Re: My server running Cloudstack-management fails to shutdown properly


Is there a way, I can delete everything in cloudstack at once and start afresh?

________________________________
From: Muhammad Adeel Zahid <16...@lums.edu.pk>
Sent: Thursday, October 19, 2017 3:10:56 PM
To: users@cloudstack.apache.org
Subject: Re: My server running Cloudstack-management fails to shutdown properly

Hi Dag,


Thanks for pointing out that I am using primary and secondary storage on machine running the management server. I was just trying to delete the primary storage but management UI shows me an error message showing me the following


Cannot delete image store with active templates backup!


Please note that I have deleted all the instances that were using storage.


Furthermore, I was working to set up new primary and secondary storage on kvm host. I did directory setup and put the right info in /etc/hosts file but I was unable to download the system vm template using following command

/usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt \
-m /secondary \
-u http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2 \
-h kvm -F

The reason of failure, obviously, is that I don't have mysql on hypervisor machine
How can I resolve these problems?


Regards
Adeel



________________________________
From: Dag Sonstebo <Da...@shapeblue.com>
Sent: Thursday, October 19, 2017 1:19:54 PM
To: users@cloudstack.apache.org
Subject: Re: My server running Cloudstack-management fails to shutdown properly

Hi Adeel,

This looks like you have an NFS share mounted *on* (rather than *from*) the management server – which is something unique in your environment. It could be you use autofs for your home folder?
Either way the error is fairly standard – the file system thinks you have a file open on the NFS share, it therefore doesn’t allow you to unmount it cleanly, leading to the shutdown hang.
To troubleshoot just do a “mount” and see what share/folder is mounted to your NFS server.


If this was on your KVM host it would make more sense – since you will be using NFS for your secondary storage the KVM host will have this mounted at some point, and it may not unmount this cleanly if it thinks there are still files in use. If so you need to shut down the KVM cloudstack agent and libvirt before unmounting the share.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 19/10/2017, 09:00, "Muhammad Adeel Zahid" <16...@lums.edu.pk> wrote:

    Hello,


    I am running cloudstack on Cent OS 6 server. When I try to shut down this machine, it hangs. It fails to stop the cloudstack-management but it surpasses this point. Furthermore, during shutdown, machine hangs with this message


    Unmounting NFS filesystem: unmount.nfs: /mnt/some-long-uuid: device is busy


    After showing above message, it hangs and I have to power off the system.


    How can I get around this problem.


    Regards

    Adeel




Dag.Sonstebo@shapeblue.com
www.shapeblue.com<http://www.shapeblue.com>
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue




Re: My server running Cloudstack-management fails to shutdown properly

Posted by Muhammad Adeel Zahid <16...@lums.edu.pk>.
Is there a way, I can delete everything in cloudstack at once and start afresh?

________________________________
From: Muhammad Adeel Zahid <16...@lums.edu.pk>
Sent: Thursday, October 19, 2017 3:10:56 PM
To: users@cloudstack.apache.org
Subject: Re: My server running Cloudstack-management fails to shutdown properly

Hi Dag,


Thanks for pointing out that I am using primary and secondary storage on machine running the management server. I was just trying to delete the primary storage but management UI shows me an error message showing me the following


Cannot delete image store with active templates backup!


Please note that I have deleted all the instances that were using storage.


Furthermore, I was working to set up new primary and secondary storage on kvm host. I did directory setup and put the right info in /etc/hosts file but I was unable to download the system vm template using following command

/usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt \
-m /secondary \
-u http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2 \
-h kvm -F

The reason of failure, obviously, is that I don't have mysql on hypervisor machine
How can I resolve these problems?


Regards
Adeel



________________________________
From: Dag Sonstebo <Da...@shapeblue.com>
Sent: Thursday, October 19, 2017 1:19:54 PM
To: users@cloudstack.apache.org
Subject: Re: My server running Cloudstack-management fails to shutdown properly

Hi Adeel,

This looks like you have an NFS share mounted *on* (rather than *from*) the management server – which is something unique in your environment. It could be you use autofs for your home folder?
Either way the error is fairly standard – the file system thinks you have a file open on the NFS share, it therefore doesn’t allow you to unmount it cleanly, leading to the shutdown hang.
To troubleshoot just do a “mount” and see what share/folder is mounted to your NFS server.


If this was on your KVM host it would make more sense – since you will be using NFS for your secondary storage the KVM host will have this mounted at some point, and it may not unmount this cleanly if it thinks there are still files in use. If so you need to shut down the KVM cloudstack agent and libvirt before unmounting the share.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 19/10/2017, 09:00, "Muhammad Adeel Zahid" <16...@lums.edu.pk> wrote:

    Hello,


    I am running cloudstack on Cent OS 6 server. When I try to shut down this machine, it hangs. It fails to stop the cloudstack-management but it surpasses this point. Furthermore, during shutdown, machine hangs with this message


    Unmounting NFS filesystem: unmount.nfs: /mnt/some-long-uuid: device is busy


    After showing above message, it hangs and I have to power off the system.


    How can I get around this problem.


    Regards

    Adeel




Dag.Sonstebo@shapeblue.com
www.shapeblue.com<http://www.shapeblue.com>
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue




Re: My server running Cloudstack-management fails to shutdown properly

Posted by Muhammad Adeel Zahid <16...@lums.edu.pk>.
Hi Dag,


Thanks for pointing out that I am using primary and secondary storage on machine running the management server. I was just trying to delete the primary storage but management UI shows me an error message showing me the following


Cannot delete image store with active templates backup!


Please note that I have deleted all the instances that were using storage.


Furthermore, I was working to set up new primary and secondary storage on kvm host. I did directory setup and put the right info in /etc/hosts file but I was unable to download the system vm template using following command

/usr/share/cloudstack-common/scripts/storage/secondary/cloud-install-sys-tmplt \
-m /secondary \
-u http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2 \
-h kvm -F

The reason of failure, obviously, is that I don't have mysql on hypervisor machine
How can I resolve these problems?


Regards
Adeel



________________________________
From: Dag Sonstebo <Da...@shapeblue.com>
Sent: Thursday, October 19, 2017 1:19:54 PM
To: users@cloudstack.apache.org
Subject: Re: My server running Cloudstack-management fails to shutdown properly

Hi Adeel,

This looks like you have an NFS share mounted *on* (rather than *from*) the management server – which is something unique in your environment. It could be you use autofs for your home folder?
Either way the error is fairly standard – the file system thinks you have a file open on the NFS share, it therefore doesn’t allow you to unmount it cleanly, leading to the shutdown hang.
To troubleshoot just do a “mount” and see what share/folder is mounted to your NFS server.


If this was on your KVM host it would make more sense – since you will be using NFS for your secondary storage the KVM host will have this mounted at some point, and it may not unmount this cleanly if it thinks there are still files in use. If so you need to shut down the KVM cloudstack agent and libvirt before unmounting the share.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 19/10/2017, 09:00, "Muhammad Adeel Zahid" <16...@lums.edu.pk> wrote:

    Hello,


    I am running cloudstack on Cent OS 6 server. When I try to shut down this machine, it hangs. It fails to stop the cloudstack-management but it surpasses this point. Furthermore, during shutdown, machine hangs with this message


    Unmounting NFS filesystem: unmount.nfs: /mnt/some-long-uuid: device is busy


    After showing above message, it hangs and I have to power off the system.


    How can I get around this problem.


    Regards

    Adeel




Dag.Sonstebo@shapeblue.com
www.shapeblue.com<http://www.shapeblue.com>
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue




Re: My server running Cloudstack-management fails to shutdown properly

Posted by Dag Sonstebo <Da...@shapeblue.com>.
Hi Adeel,

This looks like you have an NFS share mounted *on* (rather than *from*) the management server – which is something unique in your environment. It could be you use autofs for your home folder?
Either way the error is fairly standard – the file system thinks you have a file open on the NFS share, it therefore doesn’t allow you to unmount it cleanly, leading to the shutdown hang.
To troubleshoot just do a “mount” and see what share/folder is mounted to your NFS server.


If this was on your KVM host it would make more sense – since you will be using NFS for your secondary storage the KVM host will have this mounted at some point, and it may not unmount this cleanly if it thinks there are still files in use. If so you need to shut down the KVM cloudstack agent and libvirt before unmounting the share.

Regards,
Dag Sonstebo
Cloud Architect
ShapeBlue

On 19/10/2017, 09:00, "Muhammad Adeel Zahid" <16...@lums.edu.pk> wrote:

    Hello,
    
    
    I am running cloudstack on Cent OS 6 server. When I try to shut down this machine, it hangs. It fails to stop the cloudstack-management but it surpasses this point. Furthermore, during shutdown, machine hangs with this message
    
    
    Unmounting NFS filesystem: unmount.nfs: /mnt/some-long-uuid: device is busy
    
    
    After showing above message, it hangs and I have to power off the system.
    
    
    How can I get around this problem.
    
    
    Regards
    
    Adeel
    
    


Dag.Sonstebo@shapeblue.com 
www.shapeblue.com
53 Chandos Place, Covent Garden, London  WC2N 4HSUK
@shapeblue