You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by "Vash_X@gmx.de" <Va...@gmx.de> on 2022/08/28 12:04:14 UTC
Agent erros while looking up host ressources after upgrade to 4.17
Hi,
after upgradeing our CS agents to 4.17 we see in our logfiles some errors
and warnings.
Hosts are running ubuntu 20.04 - latest patches applied.
First:
After start / restart of the Agent we are getting errors that the Agent
can't get the CPU values:
2022-08-28 13:36:51,849 INFO [utils.linux.KVMHostInfo]
(Agent-Handler-1:null) (logid:) Fetching CPU speed from command "lscpu".
2022-08-28 13:36:51,858 ERROR [utils.linux.KVMHostInfo]
(Agent-Handler-1:null) (logid:) Unable to retrieve the CPU speed from lscpu.
java.lang.NullPointerException
at
java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1838)
at
java.base/jdk.internal.math.FloatingDecimal.parseFloat(FloatingDecimal.java:122)
at java.base/java.lang.Float.parseFloat(Float.java:455)
at
org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeedFromCommandLscpu(KVMHostInfo.java:107)
at
org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeed(KVMHostInfo.java:87)
at
org.apache.cloudstack.utils.linux.KVMHostInfo.getHostInfoFromLibvirt(KVMHostInfo.java:133)
at
org.apache.cloudstack.utils.linux.KVMHostInfo.<init>(KVMHostInfo.java:53)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.initialize(LibvirtComputingResource.java:3373)
at com.cloud.agent.Agent.sendStartup(Agent.java:441)
at com.cloud.agent.Agent$ServerHandler.doTask(Agent.java:1099)
at com.cloud.utils.nio.Task.call(Task.java:83)
at com.cloud.utils.nio.Task.call(Task.java:29)
at
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-08-28 13:36:51,859 INFO [utils.linux.KVMHostInfo]
(Agent-Handler-1:null) (logid:) Fetching CPU speed from file
[/sys/devices/system/cpu/cpu0/cpufreq/base_frequency].
2022-08-28 13:36:51,860 ERROR [utils.linux.KVMHostInfo]
(Agent-Handler-1:null) (logid:) Unable to retrieve the CPU speed from file
[/sys/devices/system/cpu/cpu0/cpufreq/base_frequency]
java.io.FileNotFoundException:
/sys/devices/system/cpu/cpu0/cpufreq/base_frequency (No such file or
directory)
at java.base/java.io.FileInputStream.open0(Native Method)
at java.base/java.io.FileInputStream.open(FileInputStream.java:219)
at
java.base/java.io.FileInputStream.<init>(FileInputStream.java:157)
at
java.base/java.io.FileInputStream.<init>(FileInputStream.java:112)
at java.base/java.io.FileReader.<init>(FileReader.java:60)
at
org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeedFromFile(KVMHostInfo.java:118)
at
org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeed(KVMHostInfo.java:92)
at
org.apache.cloudstack.utils.linux.KVMHostInfo.getHostInfoFromLibvirt(KVMHostInfo.java:133)
at
org.apache.cloudstack.utils.linux.KVMHostInfo.<init>(KVMHostInfo.java:53)
at
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.initialize(LibvirtComputingResource.java:3373)
at com.cloud.agent.Agent.sendStartup(Agent.java:441)
at com.cloud.agent.Agent$ServerHandler.doTask(Agent.java:1099)
at com.cloud.utils.nio.Task.call(Task.java:83)
at com.cloud.utils.nio.Task.call(Task.java:29)
at
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2022-08-28 13:36:51,860 INFO [utils.linux.KVMHostInfo]
(Agent-Handler-1:null) (logid:) Using the value [1803] provided by Libvirt.
How ever it seems that values from libvirt are provided.
More "concerning" ist the following warnings from the logfiles:
[kvm.resource.LibvirtComputingResource] (agentRequest-Handler-3:null)
(logid:44ab098e) Couldn't retrieve free memory, returning -1.
Some kind on advice / how solve these would be wonderful.
regards,
chris
Re: Agent erros while looking up host ressources after upgrade to 4.17
Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
First mitigation was to edit "agent.conf" and add the
host.cpu.manual.speed.mhz - option manually.
So the hosts are availeable for migration purposes.
So actually the warning " [kvm.resource.LibvirtComputingResource]
(agentRequest-Handler-3:null) (logid:44ab098e) Couldn't retrieve free
memory, returning -1. " is left to deal with.
Any help / information is appreciated.
Regards
Chris
Am So., 28. Aug. 2022 um 14:51 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:
> Okay, seems even worse imapacts....
>
> It seems the values for CPU_Speed are now getting wrong and impacting the
> overall allocation... i have 4 identical servers here and all are shown
> with different CPU Speed in the CS Management.
> Seems like the reported CPU speed for the agent is currently the "live"
> frequency of the cpu of the host... not the max. possible... which has been
> used before...
>
>
> Am So., 28. Aug. 2022 um 14:04 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:
>
>> Hi,
>>
>> after upgradeing our CS agents to 4.17 we see in our logfiles some errors
>> and warnings.
>> Hosts are running ubuntu 20.04 - latest patches applied.
>> First:
>> After start / restart of the Agent we are getting errors that the Agent
>> can't get the CPU values:
>>
>> 2022-08-28 13:36:51,849 INFO [utils.linux.KVMHostInfo]
>> (Agent-Handler-1:null) (logid:) Fetching CPU speed from command "lscpu".
>> 2022-08-28 13:36:51,858 ERROR [utils.linux.KVMHostInfo]
>> (Agent-Handler-1:null) (logid:) Unable to retrieve the CPU speed from lscpu.
>> java.lang.NullPointerException
>> at
>> java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1838)
>> at
>> java.base/jdk.internal.math.FloatingDecimal.parseFloat(FloatingDecimal.java:122)
>> at java.base/java.lang.Float.parseFloat(Float.java:455)
>> at
>> org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeedFromCommandLscpu(KVMHostInfo.java:107)
>> at
>> org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeed(KVMHostInfo.java:87)
>> at
>> org.apache.cloudstack.utils.linux.KVMHostInfo.getHostInfoFromLibvirt(KVMHostInfo.java:133)
>> at
>> org.apache.cloudstack.utils.linux.KVMHostInfo.<init>(KVMHostInfo.java:53)
>> at
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.initialize(LibvirtComputingResource.java:3373)
>> at com.cloud.agent.Agent.sendStartup(Agent.java:441)
>> at com.cloud.agent.Agent$ServerHandler.doTask(Agent.java:1099)
>> at com.cloud.utils.nio.Task.call(Task.java:83)
>> at com.cloud.utils.nio.Task.call(Task.java:29)
>> at
>> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>> at
>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
>> at
>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
>> at java.base/java.lang.Thread.run(Thread.java:829)
>> 2022-08-28 13:36:51,859 INFO [utils.linux.KVMHostInfo]
>> (Agent-Handler-1:null) (logid:) Fetching CPU speed from file
>> [/sys/devices/system/cpu/cpu0/cpufreq/base_frequency].
>> 2022-08-28 13:36:51,860 ERROR [utils.linux.KVMHostInfo]
>> (Agent-Handler-1:null) (logid:) Unable to retrieve the CPU speed from file
>> [/sys/devices/system/cpu/cpu0/cpufreq/base_frequency]
>> java.io.FileNotFoundException:
>> /sys/devices/system/cpu/cpu0/cpufreq/base_frequency (No such file or
>> directory)
>> at java.base/java.io.FileInputStream.open0(Native Method)
>> at
>> java.base/java.io.FileInputStream.open(FileInputStream.java:219)
>> at
>> java.base/java.io.FileInputStream.<init>(FileInputStream.java:157)
>> at
>> java.base/java.io.FileInputStream.<init>(FileInputStream.java:112)
>> at java.base/java.io.FileReader.<init>(FileReader.java:60)
>> at
>> org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeedFromFile(KVMHostInfo.java:118)
>> at
>> org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeed(KVMHostInfo.java:92)
>> at
>> org.apache.cloudstack.utils.linux.KVMHostInfo.getHostInfoFromLibvirt(KVMHostInfo.java:133)
>> at
>> org.apache.cloudstack.utils.linux.KVMHostInfo.<init>(KVMHostInfo.java:53)
>> at
>> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.initialize(LibvirtComputingResource.java:3373)
>> at com.cloud.agent.Agent.sendStartup(Agent.java:441)
>> at com.cloud.agent.Agent$ServerHandler.doTask(Agent.java:1099)
>> at com.cloud.utils.nio.Task.call(Task.java:83)
>> at com.cloud.utils.nio.Task.call(Task.java:29)
>> at
>> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>> at
>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
>> at
>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
>> at java.base/java.lang.Thread.run(Thread.java:829)
>> 2022-08-28 13:36:51,860 INFO [utils.linux.KVMHostInfo]
>> (Agent-Handler-1:null) (logid:) Using the value [1803] provided by Libvirt.
>>
>> How ever it seems that values from libvirt are provided.
>> More "concerning" ist the following warnings from the logfiles:
>>
>> [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-3:null)
>> (logid:44ab098e) Couldn't retrieve free memory, returning -1.
>>
>> Some kind on advice / how solve these would be wonderful.
>> regards,
>> chris
>>
>
Re: Agent erros while looking up host ressources after upgrade to 4.17
Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
Okay, seems even worse imapacts....
It seems the values for CPU_Speed are now getting wrong and impacting the
overall allocation... i have 4 identical servers here and all are shown
with different CPU Speed in the CS Management.
Seems like the reported CPU speed for the agent is currently the "live"
frequency of the cpu of the host... not the max. possible... which has been
used before...
Am So., 28. Aug. 2022 um 14:04 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:
> Hi,
>
> after upgradeing our CS agents to 4.17 we see in our logfiles some errors
> and warnings.
> Hosts are running ubuntu 20.04 - latest patches applied.
> First:
> After start / restart of the Agent we are getting errors that the Agent
> can't get the CPU values:
>
> 2022-08-28 13:36:51,849 INFO [utils.linux.KVMHostInfo]
> (Agent-Handler-1:null) (logid:) Fetching CPU speed from command "lscpu".
> 2022-08-28 13:36:51,858 ERROR [utils.linux.KVMHostInfo]
> (Agent-Handler-1:null) (logid:) Unable to retrieve the CPU speed from lscpu.
> java.lang.NullPointerException
> at
> java.base/jdk.internal.math.FloatingDecimal.readJavaFormatString(FloatingDecimal.java:1838)
> at
> java.base/jdk.internal.math.FloatingDecimal.parseFloat(FloatingDecimal.java:122)
> at java.base/java.lang.Float.parseFloat(Float.java:455)
> at
> org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeedFromCommandLscpu(KVMHostInfo.java:107)
> at
> org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeed(KVMHostInfo.java:87)
> at
> org.apache.cloudstack.utils.linux.KVMHostInfo.getHostInfoFromLibvirt(KVMHostInfo.java:133)
> at
> org.apache.cloudstack.utils.linux.KVMHostInfo.<init>(KVMHostInfo.java:53)
> at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.initialize(LibvirtComputingResource.java:3373)
> at com.cloud.agent.Agent.sendStartup(Agent.java:441)
> at com.cloud.agent.Agent$ServerHandler.doTask(Agent.java:1099)
> at com.cloud.utils.nio.Task.call(Task.java:83)
> at com.cloud.utils.nio.Task.call(Task.java:29)
> at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> 2022-08-28 13:36:51,859 INFO [utils.linux.KVMHostInfo]
> (Agent-Handler-1:null) (logid:) Fetching CPU speed from file
> [/sys/devices/system/cpu/cpu0/cpufreq/base_frequency].
> 2022-08-28 13:36:51,860 ERROR [utils.linux.KVMHostInfo]
> (Agent-Handler-1:null) (logid:) Unable to retrieve the CPU speed from file
> [/sys/devices/system/cpu/cpu0/cpufreq/base_frequency]
> java.io.FileNotFoundException:
> /sys/devices/system/cpu/cpu0/cpufreq/base_frequency (No such file or
> directory)
> at java.base/java.io.FileInputStream.open0(Native Method)
> at java.base/java.io.FileInputStream.open(FileInputStream.java:219)
> at
> java.base/java.io.FileInputStream.<init>(FileInputStream.java:157)
> at
> java.base/java.io.FileInputStream.<init>(FileInputStream.java:112)
> at java.base/java.io.FileReader.<init>(FileReader.java:60)
> at
> org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeedFromFile(KVMHostInfo.java:118)
> at
> org.apache.cloudstack.utils.linux.KVMHostInfo.getCpuSpeed(KVMHostInfo.java:92)
> at
> org.apache.cloudstack.utils.linux.KVMHostInfo.getHostInfoFromLibvirt(KVMHostInfo.java:133)
> at
> org.apache.cloudstack.utils.linux.KVMHostInfo.<init>(KVMHostInfo.java:53)
> at
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.initialize(LibvirtComputingResource.java:3373)
> at com.cloud.agent.Agent.sendStartup(Agent.java:441)
> at com.cloud.agent.Agent$ServerHandler.doTask(Agent.java:1099)
> at com.cloud.utils.nio.Task.call(Task.java:83)
> at com.cloud.utils.nio.Task.call(Task.java:29)
> at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> at java.base/java.lang.Thread.run(Thread.java:829)
> 2022-08-28 13:36:51,860 INFO [utils.linux.KVMHostInfo]
> (Agent-Handler-1:null) (logid:) Using the value [1803] provided by Libvirt.
>
> How ever it seems that values from libvirt are provided.
> More "concerning" ist the following warnings from the logfiles:
>
> [kvm.resource.LibvirtComputingResource] (agentRequest-Handler-3:null)
> (logid:44ab098e) Couldn't retrieve free memory, returning -1.
>
> Some kind on advice / how solve these would be wonderful.
> regards,
> chris
>