Virtual Routers Health Check Fails

[Granwille Strauss <gr...@namhost.com.INVALID>]

Hello

I updated my Almalinux 8 servers, which run Cloudstack management and 
the KVM hosts. I did not run the cloudstack management update to 4.20.1 
yet, but updated all other DNF packages. I am currently on 4.20.0 and 
after I did the normal server package updates, all my VRs are failing 
health checks which read:

connectivity.test basic false
filesystem.writable.test basic false

Then I see an error that reads in the cloudstack management UI:

---

Failed to fetch results with details: java.io.IOException: Stream closed 
at 
java.base/java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:168) 
at 
java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:334) 
at java.base/sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:287) 
at java.base/sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:330) 
at java.base/sun.nio.cs.StreamDecoder.read(StreamDecoder.java:190) at 
java.base/java.io.InputStreamReader.read(InputStreamReader.java:177) at 
java.base/java.io.BufferedReader.fill(BufferedReader.java:162) at 
java.base/java.io.BufferedReader.readLine(BufferedReader.java:329) at 
java.base/java.io.BufferedReader.readLine(BufferedReader.java:396) at 
com.cloud.utils.script.OutputInterpreter.processError(OutputInterpreter.java:41) 
at com.cloud.utils.script.Script.execute(Script.java:314) at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeInVR(LibvirtComputingResource.java:553) 
at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeInVR(LibvirtComputingResource.java:541) 
at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.checkRouterFileSystem(VirtualRoutingResource.java:419) 
at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.execute(VirtualRoutingResource.java:391) 
at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.executeQueryCommand(VirtualRoutingResource.java:227) 
at 
com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.executeRequest(VirtualRoutingResource.java:129) 
at 
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtNetworkElementCommandWrapper.execute(LibvirtNetworkElementCommandWrapper.java:35) 
at 
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtNetworkElementCommandWrapper.execute(LibvirtNetworkElementCommandWrapper.java:29) 
at 
com.cloud.hypervisor.kvm.resource.wrapper.LibvirtRequestWrapper.execute(LibvirtRequestWrapper.java:78) 
at 
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1945) 
at com.cloud.agent.Agent.processRequest(Agent.java:686) at 
com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:1109) at 
com.cloud.utils.nio.Task.call(Task.java:83) at 
com.cloud.utils.nio.Task.call(Task.java:29) at 
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 
at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 
at java.base/java.lang.Thread.run(Thread.java:840)
---

I see this error specifically under the health checks tab on the UI. I 
have rebooted cloudstack management as well as reboot one VR out of them 
all. The status are currently showing running SSVM checks also pass. Its 
simply the VRs complaining.

Any ideas what could be the reason for this?

-- 
Regards / Groete

<https://www.namhost.com> 	Granwille Strauss  // Senior Systems Admin

*e:* granwille@namhost.com
*m:* +264 81 323 1260 <tel:+264813231260>
*w:* www.namhost.com <https://www.namhost.com/>

<https://www.facebook.com/namhost> <https://twitter.com/namhost> 
<https://www.instagram.com/namhostinternetservices/> 
<https://www.linkedin.com/company/namhost> 
<https://www.youtube.com/channel/UCTd5v-kVPaic_dguGur15AA>

<https://www.namhost.com/your-move>

Namhost Internet Services (Pty) Ltd ,

                     24 Black Eagle Rd, Hermanus, 7210, RSA
                 


The content of this message is confidential. If you have received it by 
mistake, please inform us by email reply and then delete the message. It 
is forbidden to copy, forward, or in any way reveal the contents of this 
message to anyone without our explicit consent. The integrity and 
security of this email cannot be guaranteed over the Internet. 
Therefore, the sender will not be held liable for any damage caused by 
the message. For our full privacy policy and disclaimers, please go to 
https://www.namhost.com/privacy-policy