You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Granwille Strauss <gr...@namhost.com.INVALID> on 2022/09/29 10:16:47 UTC

Cannot find storage pool

Hi Guys

I tried making volume snapshots and the first 4 VMs were succesfull. 
When I tried the 5th VM volume snapshot, the process just "hung" and 
managed to get stuck in "snapshotting" and in "Creating" states.

I rebooted both my KVM server and CM server and now the host cannot 
connect to CM. I am getting this error:

> 2022-09-29 12:11:37,104 INFO [kvm.storage.LibvirtStorageAdaptor] 
> (agentRequest-Handler-2:null) (logid:c2cf2636) Didn't find an existing 
> storage pool 81ffca3a-9775-375d-a1c0-9504c0ec3d89 by UUID, checking 
> for pools with duplicate paths

I updated the snapshots and volumes table in database and set status and 
state to "Ready" and "BackedUp" restarted CM and agent with no luck. I 
rebooted libvrtd too but its looking for the storage pool and I have no 
idea where or what happened with it:

> internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec 
> 156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89) 
> unexpected exit st>

My primary storage is on CM server at /mnt/primary but I also have local 
storage enabled at /var/lib/libvirt/images

Any help please? My host is not connecting any more and all production 
VMs are down.

-- 
Regards / Groete

<https://www.namhost.com> 	Granwille Strauss  // Senior Systems Admin

*e:* granwille@namhost.com
*m:* +264 81 323 1260 <tel:+264813231260>
*w:* www.namhost.com <https://www.namhost.com/>

<https://www.facebook.com/namhost><https://twitter.com/namhost><https://www.instagram.com/namhostinternetservices/><https://www.linkedin.com/company/namhos><https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>

<https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>

Namhost Internet Services (Pty) Ltd,

24 Black Eagle Rd, Hermanus, 7210, RSA



The content of this message is confidential. If you have received it by 
mistake, please inform us by email reply and then delete the message. It 
is forbidden to copy, forward, or in any way reveal the contents of this 
message to anyone without our explicit consent. The integrity and 
security of this email cannot be guaranteed over the Internet. 
Therefore, the sender will not be held liable for any damage caused by 
the message. For our full privacy policy and disclaimers, please go to 
https://www.namhost.com/privacy-policy

Powered by AdSigner 
<https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>

Re: Cannot find storage pool

Posted by Nicolas Vazquez <Ni...@shapeblue.com>.
Hi Groete,

If the problem still persists, can you please increase the log level to debug on the KVM host, recreate the issue and share if any issues on the host agent logs?

Regards,
Nicolas Vazquez


From: Nux <nu...@li.nux.ro>
Date: Thursday, 29 September 2022 at 11:08
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Cc: Granwille Strauss <gr...@namhost.com.invalid>
Subject: Re: Cannot find storage pool

If you have a firewall between hosts and NFS server turn it off and try again.

Also try to force NFS protocol v3 or 4, see if it makes a difference.
---
Nux
www.nux.ro<http://www.nux.ro>



On 2022-09-29 13:28, Granwille Strauss wrote:

The problem is back again. I tried creating new volume snapshot again. And once again, the process has gone stuck.

All I's up and running, NFS is also active. Maybe this is a bug for KVM?
On 9/29/22 13:41, Granwille Strauss wrote:

Hi

I am not sure what happened but during the Volume Snap I ran my NFS server magically stopped working. And this caused the snap process to hung and also caused the mount error below.

I had to comment the lines in /etc/exports, reload deamon and only then could I start NFS again. I then uncomment lines in /etc/exports and deamon reload again and now storage was back up and now host can connect to CM again.

Not sure why NFS random dropped for no reason.
On 9/29/22 12:36, Slavka Peleva wrote:

Hi Groete,



Can you share the end of this message?



internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec

156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)

unexpected exit st>



Best regards,

Slavka



On Thu, Sep 29, 2022 at 1:17 PM Granwille Strauss

<gr...@namhost.com.invalid> wrote:



Hi Guys



I tried making volume snapshots and the first 4 VMs were succesfull. When

I tried the 5th VM volume snapshot, the process just "hung" and managed to

get stuck in "snapshotting" and in "Creating" states.



I rebooted both my KVM server and CM server and now the host cannot

connect to CM. I am getting this error:



2022-09-29 12:11:37,104 INFO  [kvm.storage.LibvirtStorageAdaptor]

(agentRequest-Handler-2:null) (logid:c2cf2636) Didn't find an existing

storage pool 81ffca3a-9775-375d-a1c0-9504c0ec3d89 by UUID, checking for

pools with duplicate paths



I updated the snapshots and volumes table in database and set status and

state to "Ready" and "BackedUp" restarted CM and agent with no luck. I

rebooted libvrtd too but its looking for the storage pool and I have no

idea where or what happened with it:



internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec

156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)

unexpected exit st>



My primary storage is on CM server at /mnt/primary but I also have local

storage enabled at /var/lib/libvirt/images



Any help please? My host is not connecting any more and all production VMs

are down.

--

Regards / Groete



<https://www.namhost.com><https://www.namhost.com> Granwille Strauss  //  Senior Systems Admin



*e:* granwille@namhost.com<ma...@namhost.com>

*m:* +264 81 323 1260 <+264813231260>

*w:* www.namhost.com<http://www.namhost.com>



<https://www.facebook.com/namhost><https://www.facebook.com/namhost> <https://twitter.com/namhost><https://twitter.com/namhost>

<https://www.instagram.com/namhostinternetservices/><https://www.instagram.com/namhostinternetservices/>

<https://www.linkedin.com/company/namhos><https://www.linkedin.com/company/namhos>

<https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA><https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>





<https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner><https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>



Namhost Internet Services (Pty) Ltd,



24 Black Eagle Rd, Hermanus, 7210, RSA







The content of this message is confidential. If you have received it by

mistake, please inform us by email reply and then delete the message. It is

forbidden to copy, forward, or in any way reveal the contents of this

message to anyone without our explicit consent. The integrity and security

of this email cannot be guaranteed over the Internet. Therefore, the sender

will not be held liable for any damage caused by the message. For our full

privacy policy and disclaimers, please go to

https://www.namhost.com/privacy-policy



[image: Powered by AdSigner]

<https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818><https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>


--
Regards / Groete
[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.namhost.com/>
Granwille Strauss  //  Senior Systems Admin

e: granwille@namhost.com<ma...@namhost.com>
m: +264 81 323 1260<tel:+264813231260>
w: www.namhost.com<https://www.namhost.com/>

[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.facebook.com/namhost>[cid:16644604786335a6be94617061139313@li.nux.ro]<https://twitter.com/namhost>[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.instagram.com/namhostinternetservices/>[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.linkedin.com/company/namhos>[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>

[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>
Namhost Internet Services (Pty) Ltd,

24 Black Eagle Rd, Hermanus, 7210, RSA

The content of this message is confidential. If you have received it by mistake, please inform us by email reply and then delete the message. It is forbidden to copy, forward, or in any way reveal the contents of this message to anyone without our explicit consent. The integrity and security of this email cannot be guaranteed over the Internet. Therefore, the sender will not be held liable for any damage caused by the message. For our full privacy policy and disclaimers, please go to https://www.namhost.com/privacy-policy

[Powered by AdSigner]<https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>
--
Regards / Groete
[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.namhost.com/>
Granwille Strauss  //  Senior Systems Admin

e: granwille@namhost.com<ma...@namhost.com>
m: +264 81 323 1260<tel:+264813231260>
w: www.namhost.com<https://www.namhost.com/>

[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.facebook.com/namhost>[cid:16644604786335a6be94617061139313@li.nux.ro]<https://twitter.com/namhost>[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.instagram.com/namhostinternetservices/>[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.linkedin.com/company/namhos>[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>

[cid:16644604786335a6be94617061139313@li.nux.ro]<https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>
Namhost Internet Services (Pty) Ltd,

24 Black Eagle Rd, Hermanus, 7210, RSA

The content of this message is confidential. If you have received it by mistake, please inform us by email reply and then delete the message. It is forbidden to copy, forward, or in any way reveal the contents of this message to anyone without our explicit consent. The integrity and security of this email cannot be guaranteed over the Internet. Therefore, the sender will not be held liable for any damage caused by the message. For our full privacy policy and disclaimers, please go to https://www.namhost.com/privacy-policy

[Powered by AdSigner]<https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>

 


Re: Cannot find storage pool

Posted by Nux <nu...@li.nux.ro>.

If you have a firewall between hosts and NFS server turn it off and try 
again.

Also try to force NFS protocol v3 or 4, see if it makes a difference.

---
Nux
www.nux.ro [10]

On 2022-09-29 13:28, Granwille Strauss wrote:

> The problem is back again. I tried creating new volume snapshot again. 
> And once again, the process has gone stuck.
> 
> All I's up and running, NFS is also active. Maybe this is a bug for 
> KVM?
> 
> On 9/29/22 13:41, Granwille Strauss wrote:
> 
> Hi
> 
> I am not sure what happened but during the Volume Snap I ran my NFS 
> server magically stopped working. And this caused the snap process to 
> hung and also caused the mount error below.
> 
> I had to comment the lines in /etc/exports, reload deamon and only then 
> could I start NFS again. I then uncomment lines in /etc/exports and 
> deamon reload again and now storage was back up and now host can 
> connect to CM again.
> 
> Not sure why NFS random dropped for no reason.
> 
> On 9/29/22 12:36, Slavka Peleva wrote:
> 
> Hi Groete,
> 
> Can you share the end of this message?
> 
> internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec
> 156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)
> unexpected exit st>
> 
> Best regards,
> 
> Slavka
> 
> On Thu, Sep 29, 2022 at 1:17 PM Granwille Strauss
> <gr...@namhost.com.invalid> wrote:
> 
> Hi Guys
> 
> I tried making volume snapshots and the first 4 VMs were succesfull. 
> When
> I tried the 5th VM volume snapshot, the process just "hung" and managed 
> to
> get stuck in "snapshotting" and in "Creating" states.
> 
> I rebooted both my KVM server and CM server and now the host cannot
> connect to CM. I am getting this error:
> 
> 2022-09-29 12:11:37,104 INFO  [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-2:null) (logid:c2cf2636) Didn't find an existing
> storage pool 81ffca3a-9775-375d-a1c0-9504c0ec3d89 by UUID, checking for
> pools with duplicate paths
> 
> I updated the snapshots and volumes table in database and set status 
> and
> state to "Ready" and "BackedUp" restarted CM and agent with no luck. I
> rebooted libvrtd too but its looking for the storage pool and I have no
> idea where or what happened with it:
> 
> internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec
> 156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)
> unexpected exit st>
> 
> My primary storage is on CM server at /mnt/primary but I also have 
> local
> storage enabled at /var/lib/libvirt/images
> 
> Any help please? My host is not connecting any more and all production 
> VMs
> are down.
> --
> Regards / Groete
> 
> <https://www.namhost.com> [1] Granwille Strauss  //  Senior Systems 
> Admin
> 
> *e:* granwille@namhost.com
> *m:* +264 81 323 1260 <+264813231260>
> *w:* www.namhost.com [2]
> 
> <https://www.facebook.com/namhost> [3] <https://twitter.com/namhost> 
> [4]
> <https://www.instagram.com/namhostinternetservices/> [5]
> <https://www.linkedin.com/company/namhos> [6]
> <https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA> [7]
> 
> <https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner> 
> [8]
> 
> Namhost Internet Services (Pty) Ltd,
> 
> 24 Black Eagle Rd, Hermanus, 7210, RSA
> 
> The content of this message is confidential. If you have received it by
> mistake, please inform us by email reply and then delete the message. 
> It is
> forbidden to copy, forward, or in any way reveal the contents of this
> message to anyone without our explicit consent. The integrity and 
> security
> of this email cannot be guaranteed over the Internet. Therefore, the 
> sender
> will not be held liable for any damage caused by the message. For our 
> full
> privacy policy and disclaimers, please go to
> https://www.namhost.com/privacy-policy
> 
> [image: Powered by AdSigner]
> <https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818> 
> [9]

-- 

  Regards / Groete

  		 [1]
  Granwille Strauss  //  Senior Systems Admin

e: granwille@namhost.com
m: +264 81 323 1260 [11]
w: www.namhost.com [12]

  [3] [4] [5] [6] [7]

  [8]

  Namhost Internet Services (Pty) Ltd,

24 Black Eagle Rd, Hermanus, 7210, RSA

  		The content of this message is confidential. If you have received it 
by mistake, please inform us by email reply and then delete the message. 
It is forbidden to copy, forward, or in any way reveal the contents of 
this message to anyone without our explicit consent. The integrity and 
security of this email cannot be guaranteed over the Internet. 
Therefore, the sender will not be held liable for any damage caused by 
the message. For our full privacy policy and disclaimers, please go to 
https://www.namhost.com/privacy-policy

                                                             [9]
-- 

  Regards / Groete

  		 [1]
  Granwille Strauss  //  Senior Systems Admin

e: granwille@namhost.com
m: +264 81 323 1260 [11]
w: www.namhost.com [12]

  [3] [4] [5] [6] [7]

  [8]

  Namhost Internet Services (Pty) Ltd,

24 Black Eagle Rd, Hermanus, 7210, RSA

  		The content of this message is confidential. If you have received it 
by mistake, please inform us by email reply and then delete the message. 
It is forbidden to copy, forward, or in any way reveal the contents of 
this message to anyone without our explicit consent. The integrity and 
security of this email cannot be guaranteed over the Internet. 
Therefore, the sender will not be held liable for any damage caused by 
the message. For our full privacy policy and disclaimers, please go to 
https://www.namhost.com/privacy-policy

                                                             [9]

Links:
------
[1] https://www.namhost.com
[2] http://www.namhost.com
[3] https://www.facebook.com/namhost
[4] https://twitter.com/namhost
[5] https://www.instagram.com/namhostinternetservices/
[6] https://www.linkedin.com/company/namhos
[7] https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA
[8] 
https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner
[9] 
https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818
[10] http://www.nux.ro
[11] tel:+264813231260
[12] https://www.namhost.com/

Re: Cannot find storage pool

Posted by Granwille Strauss <gr...@namhost.com.INVALID>.
The problem is back again. I tried creating new volume snapshot again. 
And once again, the process has gone stuck.

All I's up and running, NFS is also active. Maybe this is a bug for KVM?

On 9/29/22 13:41, Granwille Strauss wrote:
>
> Hi
>
> I am not sure what happened but during the Volume Snap I ran my NFS 
> server magically stopped working. And this caused the snap process to 
> hung and also caused the mount error below.
>
> I had to comment the lines in /etc/exports, reload deamon and only 
> then could I start NFS again. I then uncomment lines in /etc/exports 
> and deamon reload again and now storage was back up and now host can 
> connect to CM again.
>
> Not sure why NFS random dropped for no reason.
>
> On 9/29/22 12:36, Slavka Peleva wrote:
>> Hi Groete,
>>
>> Can you share the end of this message?
>>
>>> internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec
>>> 156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)
>>> unexpected exit st>
>>>
>>> Best regards,
>> Slavka
>>
>> On Thu, Sep 29, 2022 at 1:17 PM Granwille Strauss
>> <gr...@namhost.com.invalid>  wrote:
>>
>>> Hi Guys
>>>
>>> I tried making volume snapshots and the first 4 VMs were succesfull. When
>>> I tried the 5th VM volume snapshot, the process just "hung" and managed to
>>> get stuck in "snapshotting" and in "Creating" states.
>>>
>>> I rebooted both my KVM server and CM server and now the host cannot
>>> connect to CM. I am getting this error:
>>>
>>> 2022-09-29 12:11:37,104 INFO  [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-2:null) (logid:c2cf2636) Didn't find an existing
>>> storage pool 81ffca3a-9775-375d-a1c0-9504c0ec3d89 by UUID, checking for
>>> pools with duplicate paths
>>>
>>> I updated the snapshots and volumes table in database and set status and
>>> state to "Ready" and "BackedUp" restarted CM and agent with no luck. I
>>> rebooted libvrtd too but its looking for the storage pool and I have no
>>> idea where or what happened with it:
>>>
>>> internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec
>>> 156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)
>>> unexpected exit st>
>>>
>>> My primary storage is on CM server at /mnt/primary but I also have local
>>> storage enabled at /var/lib/libvirt/images
>>>
>>> Any help please? My host is not connecting any more and all production VMs
>>> are down.
>>> --
>>> Regards / Groete
>>>
>>> <https://www.namhost.com>  Granwille Strauss  //  Senior Systems Admin
>>>
>>> *e:*granwille@namhost.com
>>> *m:* +264 81 323 1260 <+264813231260>
>>> *w:*www.namhost.com
>>>
>>> <https://www.facebook.com/namhost>  <https://twitter.com/namhost>
>>> <https://www.instagram.com/namhostinternetservices/>
>>> <https://www.linkedin.com/company/namhos>
>>> <https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>
>>>
>>>
>>> <https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>
>>>
>>> Namhost Internet Services (Pty) Ltd,
>>>
>>> 24 Black Eagle Rd, Hermanus, 7210, RSA
>>>
>>>
>>>
>>> The content of this message is confidential. If you have received it by
>>> mistake, please inform us by email reply and then delete the message. It is
>>> forbidden to copy, forward, or in any way reveal the contents of this
>>> message to anyone without our explicit consent. The integrity and security
>>> of this email cannot be guaranteed over the Internet. Therefore, the sender
>>> will not be held liable for any damage caused by the message. For our full
>>> privacy policy and disclaimers, please go to
>>> https://www.namhost.com/privacy-policy
>>>
>>> [image: Powered by AdSigner]
>>> <https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>
>>>
> -- 
> Regards / Groete
>
> <https://www.namhost.com> 	Granwille Strauss  // Senior Systems Admin
>
> *e:* granwille@namhost.com
> *m:* +264 81 323 1260 <tel:+264813231260>
> *w:* www.namhost.com <https://www.namhost.com/>
>
> <https://www.facebook.com/namhost><https://twitter.com/namhost><https://www.instagram.com/namhostinternetservices/><https://www.linkedin.com/company/namhos><https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>
>
> <https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>
>
> Namhost Internet Services (Pty) Ltd,
> 24 Black Eagle Rd, Hermanus, 7210, RSA
>
>
> The content of this message is confidential. If you have received it 
> by mistake, please inform us by email reply and then delete the 
> message. It is forbidden to copy, forward, or in any way reveal the 
> contents of this message to anyone without our explicit consent. The 
> integrity and security of this email cannot be guaranteed over the 
> Internet. Therefore, the sender will not be held liable for any damage 
> caused by the message. For our full privacy policy and disclaimers, 
> please go to https://www.namhost.com/privacy-policy
>
> Powered by AdSigner 
> <https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>
-- 
Regards / Groete

<https://www.namhost.com> 	Granwille Strauss  // Senior Systems Admin

*e:* granwille@namhost.com
*m:* +264 81 323 1260 <tel:+264813231260>
*w:* www.namhost.com <https://www.namhost.com/>

<https://www.facebook.com/namhost><https://twitter.com/namhost><https://www.instagram.com/namhostinternetservices/><https://www.linkedin.com/company/namhos><https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>

<https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>

Namhost Internet Services (Pty) Ltd,

24 Black Eagle Rd, Hermanus, 7210, RSA



The content of this message is confidential. If you have received it by 
mistake, please inform us by email reply and then delete the message. It 
is forbidden to copy, forward, or in any way reveal the contents of this 
message to anyone without our explicit consent. The integrity and 
security of this email cannot be guaranteed over the Internet. 
Therefore, the sender will not be held liable for any damage caused by 
the message. For our full privacy policy and disclaimers, please go to 
https://www.namhost.com/privacy-policy

Powered by AdSigner 
<https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>

Re: Cannot find storage pool

Posted by Granwille Strauss <gr...@namhost.com.INVALID>.
Hi

I am not sure what happened but during the Volume Snap I ran my NFS 
server magically stopped working. And this caused the snap process to 
hung and also caused the mount error below.

I had to comment the lines in /etc/exports, reload deamon and only then 
could I start NFS again. I then uncomment lines in /etc/exports and 
deamon reload again and now storage was back up and now host can connect 
to CM again.

Not sure why NFS random dropped for no reason.

On 9/29/22 12:36, Slavka Peleva wrote:
> Hi Groete,
>
> Can you share the end of this message?
>
>> internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec
>> 156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)
>> unexpected exit st>
>>
>> Best regards,
> Slavka
>
> On Thu, Sep 29, 2022 at 1:17 PM Granwille Strauss
> <gr...@namhost.com.invalid>  wrote:
>
>> Hi Guys
>>
>> I tried making volume snapshots and the first 4 VMs were succesfull. When
>> I tried the 5th VM volume snapshot, the process just "hung" and managed to
>> get stuck in "snapshotting" and in "Creating" states.
>>
>> I rebooted both my KVM server and CM server and now the host cannot
>> connect to CM. I am getting this error:
>>
>> 2022-09-29 12:11:37,104 INFO  [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-2:null) (logid:c2cf2636) Didn't find an existing
>> storage pool 81ffca3a-9775-375d-a1c0-9504c0ec3d89 by UUID, checking for
>> pools with duplicate paths
>>
>> I updated the snapshots and volumes table in database and set status and
>> state to "Ready" and "BackedUp" restarted CM and agent with no luck. I
>> rebooted libvrtd too but its looking for the storage pool and I have no
>> idea where or what happened with it:
>>
>> internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec
>> 156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)
>> unexpected exit st>
>>
>> My primary storage is on CM server at /mnt/primary but I also have local
>> storage enabled at /var/lib/libvirt/images
>>
>> Any help please? My host is not connecting any more and all production VMs
>> are down.
>> --
>> Regards / Groete
>>
>> <https://www.namhost.com>  Granwille Strauss  //  Senior Systems Admin
>>
>> *e:*granwille@namhost.com
>> *m:* +264 81 323 1260 <+264813231260>
>> *w:*www.namhost.com
>>
>> <https://www.facebook.com/namhost>  <https://twitter.com/namhost>
>> <https://www.instagram.com/namhostinternetservices/>
>> <https://www.linkedin.com/company/namhos>
>> <https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>
>>
>>
>> <https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>
>>
>> Namhost Internet Services (Pty) Ltd,
>>
>> 24 Black Eagle Rd, Hermanus, 7210, RSA
>>
>>
>>
>> The content of this message is confidential. If you have received it by
>> mistake, please inform us by email reply and then delete the message. It is
>> forbidden to copy, forward, or in any way reveal the contents of this
>> message to anyone without our explicit consent. The integrity and security
>> of this email cannot be guaranteed over the Internet. Therefore, the sender
>> will not be held liable for any damage caused by the message. For our full
>> privacy policy and disclaimers, please go to
>> https://www.namhost.com/privacy-policy
>>
>> [image: Powered by AdSigner]
>> <https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>
>>
-- 
Regards / Groete

<https://www.namhost.com> 	Granwille Strauss  // Senior Systems Admin

*e:* granwille@namhost.com
*m:* +264 81 323 1260 <tel:+264813231260>
*w:* www.namhost.com <https://www.namhost.com/>

<https://www.facebook.com/namhost><https://twitter.com/namhost><https://www.instagram.com/namhostinternetservices/><https://www.linkedin.com/company/namhos><https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>

<https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>

Namhost Internet Services (Pty) Ltd,

24 Black Eagle Rd, Hermanus, 7210, RSA



The content of this message is confidential. If you have received it by 
mistake, please inform us by email reply and then delete the message. It 
is forbidden to copy, forward, or in any way reveal the contents of this 
message to anyone without our explicit consent. The integrity and 
security of this email cannot be guaranteed over the Internet. 
Therefore, the sender will not be held liable for any damage caused by 
the message. For our full privacy policy and disclaimers, please go to 
https://www.namhost.com/privacy-policy

Powered by AdSigner 
<https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>

Re: Cannot find storage pool

Posted by Slavka Peleva <sl...@storpool.com.INVALID>.
Hi Groete,

Can you share the end of this message?

> internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec
> 156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)
> unexpected exit st>
>
> Best regards,
Slavka

On Thu, Sep 29, 2022 at 1:17 PM Granwille Strauss
<gr...@namhost.com.invalid> wrote:

> Hi Guys
>
> I tried making volume snapshots and the first 4 VMs were succesfull. When
> I tried the 5th VM volume snapshot, the process just "hung" and managed to
> get stuck in "snapshotting" and in "Creating" states.
>
> I rebooted both my KVM server and CM server and now the host cannot
> connect to CM. I am getting this error:
>
> 2022-09-29 12:11:37,104 INFO  [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-2:null) (logid:c2cf2636) Didn't find an existing
> storage pool 81ffca3a-9775-375d-a1c0-9504c0ec3d89 by UUID, checking for
> pools with duplicate paths
>
> I updated the snapshots and volumes table in database and set status and
> state to "Ready" and "BackedUp" restarted CM and agent with no luck. I
> rebooted libvrtd too but its looking for the storage pool and I have no
> idea where or what happened with it:
>
> internal error: Child process (/usr/bin/mount -o nodev,nosuid,noexec
> 156.38.173.122:/mnt/primary /mnt/81ffca3a-9775-375d-a1c0-9504c0ec3d89)
> unexpected exit st>
>
> My primary storage is on CM server at /mnt/primary but I also have local
> storage enabled at /var/lib/libvirt/images
>
> Any help please? My host is not connecting any more and all production VMs
> are down.
> --
> Regards / Groete
>
> <https://www.namhost.com> Granwille Strauss  //  Senior Systems Admin
>
> *e:* granwille@namhost.com
> *m:* +264 81 323 1260 <+264813231260>
> *w:* www.namhost.com
>
> <https://www.facebook.com/namhost> <https://twitter.com/namhost>
> <https://www.instagram.com/namhostinternetservices/>
> <https://www.linkedin.com/company/namhos>
> <https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>
>
>
> <https://www.adsigner.com/v1/l/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818/banner>
>
> Namhost Internet Services (Pty) Ltd,
>
> 24 Black Eagle Rd, Hermanus, 7210, RSA
>
>
>
> The content of this message is confidential. If you have received it by
> mistake, please inform us by email reply and then delete the message. It is
> forbidden to copy, forward, or in any way reveal the contents of this
> message to anyone without our explicit consent. The integrity and security
> of this email cannot be guaranteed over the Internet. Therefore, the sender
> will not be held liable for any damage caused by the message. For our full
> privacy policy and disclaimers, please go to
> https://www.namhost.com/privacy-policy
>
> [image: Powered by AdSigner]
> <https://www.adsigner.com/v1/c/631091998d4670001fe43ec2/621c9b76c140bb001ed0f818>
>