You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by "Vash_X@gmx.de" <Va...@gmx.de> on 2021/09/24 09:07:10 UTC
SSCM and CSVM status starting till abort / libvirt: invalid
connection pointer in virConnectGetVersion
Hi,
i am running into problems within my new setup - and i currently don't know
where to look for to debug this.
Environment:
Newly installed
CS 4.15.2
Ubuntu 20.04 + KVM
1x Management Server + 1 Host
Deploying Advanced Networking Zone
Up to this point everything is running fine. Didn't found errors in the log
files.
However: When enabling the zone the SSVM and CSVM are changeing to started
but never reach "running".
Taking a look into the agent.log i stumbled upon this ("..." = repetion of
entries):
2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
SSL: Handshake done
2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
Connected to 172.17.1.2:8250
2021-09-24 01:01:55,373 INFO [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Attempting to create storage pool
8362564e-11fd-4dd8-bae1-f90d53e52dab (Filesystem) in libvirt
2021-09-24 01:01:55,379 ERROR [kvm.resource.LibvirtConnection]
(Agent-Handler-1:null) (logid:) Connection with libvirtd is broken: invalid
connection pointer in virConnectGetVersion
2021-09-24 01:01:55,381 WARN [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Storage pool
8362564e-11fd-4dd8-bae1-f90d53e52dab was not found running in libvirt. Need
to create it.
2021-09-24 01:01:55,381 INFO [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Didn't find an existing storage pool
8362564e-11fd-4dd8-bae1-f90d53e52dab by UUID, checking for pools with
duplicate paths
2021-09-24 01:01:55,383 INFO [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Trying to fetch storage pool
8362564e-11fd-4dd8-bae1-f90d53e52dab from libvirt
2021-09-24 01:01:55,424 INFO [cloud.serializer.GsonHelper]
(Agent-Handler-1:null) (logid:) Default Builder inited.
2021-09-24 01:01:55,470 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
(logid:) Proccess agent startup answer, agent id = 0
2021-09-24 01:01:55,471 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
(logid:) Set agent id 0
2021-09-24 01:01:55,476 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
(logid:) Startup Response Received: agent id = 0
2021-09-24 01:01:55,701 INFO [cloud.agent.Agent]
(agentRequest-Handler-3:null) (logid:9e52178e) Processing agent ready
command, agent id = 1
2021-09-24 01:01:55,702 INFO [cloud.agent.Agent]
(agentRequest-Handler-3:null) (logid:9e52178e) Set agent id 1
2021-09-24 01:01:55,707 INFO [cloud.agent.Agent]
(agentRequest-Handler-3:null) (logid:9e52178e) Ready command is processed
for agent id = 1
2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Processing agent ready
command, agent id = 1
2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Set agent id 1
2021-09-24 01:01:55,808 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Processed new management
server list: 172.17.1.2@static
2021-09-24 01:01:55,809 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Ready command is processed
for agent id = 1
2021-09-24 01:02:24,490 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Attempting to create storage
pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b (NetworkFilesystem) in libvirt
2021-09-24 01:02:24,510 WARN [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b was not found running in libvirt. Need
to create it.
2021-09-24 01:02:24,510 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Didn't find an existing
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b by UUID, checking for
pools with duplicate paths
2021-09-24 01:02:24,708 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:02:40,975 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:74acba6b) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:02:41,001 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:74acba6b) Asking libvirt to refresh
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
...
2021-09-24 01:08:41,382 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:94789a51) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:08:41,405 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:94789a51) Asking libvirt to refresh
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
2021-09-24 01:08:52,046 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create storage
pool a93ac95f-6a93-30b3-b4ee-822203da20bb (NetworkFilesystem) in libvirt
2021-09-24 01:08:52,066 WARN [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Storage pool
a93ac95f-6a93-30b3-b4ee-822203da20bb was not found running in libvirt. Need
to create it.
2021-09-24 01:08:52,066 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Didn't find an existing
storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb by UUID, checking for
pools with duplicate paths
2021-09-24 01:08:52,192 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool
a93ac95f-6a93-30b3-b4ee-822203da20bb from libvirt
2021-09-24 01:08:52,212 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:08:52,218 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:08:52,223 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create volume
3bf5af85-ca39-4e92-9149-1d7107983af0 (NetworkFilesystem) in pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b with size (2.44 GB) 2621440000
2021-09-24 01:09:41,425 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:0b231655) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:09:41,449 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:0b231655) Asking libvirt to refresh
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
...
2021-09-24 02:08:47,897 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:95f136df) Trying to fetch storage pool
8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 02:08:47,921 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:95f136df) Asking libvirt to refresh
storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
2021-09-24 02:08:52,245 WARN [utils.script.Script] (Script-8:null)
(logid:) Interrupting script.
2021-09-24 02:08:52,247 WARN [utils.script.Script]
(agentRequest-Handler-5:null) (logid:3da47ae9) Timed out: qemu-img info
/mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
. Output is:
2021-09-24 02:08:52,248 ERROR [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Failed to fetch the
information of file
/mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
the error was: timeout
So currently i am a bit stunned as i don't really know on how to move on
from this point as everything else seems running / accessable.
Thanks in advance!
RE: SSCM and CSVM status starting till abort / libvirt: invalid connection pointer in virConnectGetVersion
Posted by cr...@istream.today.
Hi,
First, enable the debug mode in cloudstack agent and restart the agent.
Regards,
Cristian
-----Original Message-----
From: Vash_X@gmx.de <Va...@gmx.de>
Sent: Friday, September 24, 2021 12:07 PM
To: users@cloudstack.apache.org
Subject: SSCM and CSVM status starting till abort / libvirt: invalid connection pointer in virConnectGetVersion
Hi,
i am running into problems within my new setup - and i currently don't know where to look for to debug this.
Environment:
Newly installed
CS 4.15.2
Ubuntu 20.04 + KVM
1x Management Server + 1 Host
Deploying Advanced Networking Zone
Up to this point everything is running fine. Didn't found errors in the log files.
However: When enabling the zone the SSVM and CSVM are changeing to started but never reach "running".
Taking a look into the agent.log i stumbled upon this ("..." = repetion of
entries):
2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
SSL: Handshake done
2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 172.17.1.2:8250
2021-09-24 01:01:55,373 INFO [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Attempting to create storage pool 8362564e-11fd-4dd8-bae1-f90d53e52dab (Filesystem) in libvirt
2021-09-24 01:01:55,379 ERROR [kvm.resource.LibvirtConnection]
(Agent-Handler-1:null) (logid:) Connection with libvirtd is broken: invalid connection pointer in virConnectGetVersion
2021-09-24 01:01:55,381 WARN [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Storage pool 8362564e-11fd-4dd8-bae1-f90d53e52dab was not found running in libvirt. Need to create it.
2021-09-24 01:01:55,381 INFO [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 8362564e-11fd-4dd8-bae1-f90d53e52dab by UUID, checking for pools with duplicate paths
2021-09-24 01:01:55,383 INFO [kvm.storage.LibvirtStorageAdaptor]
(Agent-Handler-1:null) (logid:) Trying to fetch storage pool 8362564e-11fd-4dd8-bae1-f90d53e52dab from libvirt
2021-09-24 01:01:55,424 INFO [cloud.serializer.GsonHelper]
(Agent-Handler-1:null) (logid:) Default Builder inited.
2021-09-24 01:01:55,470 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
(logid:) Proccess agent startup answer, agent id = 0
2021-09-24 01:01:55,471 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
(logid:) Set agent id 0
2021-09-24 01:01:55,476 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
(logid:) Startup Response Received: agent id = 0
2021-09-24 01:01:55,701 INFO [cloud.agent.Agent]
(agentRequest-Handler-3:null) (logid:9e52178e) Processing agent ready command, agent id = 1
2021-09-24 01:01:55,702 INFO [cloud.agent.Agent]
(agentRequest-Handler-3:null) (logid:9e52178e) Set agent id 1
2021-09-24 01:01:55,707 INFO [cloud.agent.Agent]
(agentRequest-Handler-3:null) (logid:9e52178e) Ready command is processed for agent id = 1
2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Processing agent ready command, agent id = 1
2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Set agent id 1
2021-09-24 01:01:55,808 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Processed new management server list: 172.17.1.2@static
2021-09-24 01:01:55,809 INFO [cloud.agent.Agent]
(agentRequest-Handler-4:null) (logid:9e52178e) Ready command is processed for agent id = 1
2021-09-24 01:02:24,490 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Attempting to create storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b (NetworkFilesystem) in libvirt
2021-09-24 01:02:24,510 WARN [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b was not found running in libvirt. Need to create it.
2021-09-24 01:02:24,510 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Didn't find an existing storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b by UUID, checking for pools with duplicate paths
2021-09-24 01:02:24,708 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:b81c6af6) Trying to fetch storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:02:40,975 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:74acba6b) Trying to fetch storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:02:41,001 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:74acba6b) Asking libvirt to refresh storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
...
2021-09-24 01:08:41,382 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:94789a51) Trying to fetch storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:08:41,405 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:94789a51) Asking libvirt to refresh storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
2021-09-24 01:08:52,046 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb (NetworkFilesystem) in libvirt
2021-09-24 01:08:52,066 WARN [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb was not found running in libvirt. Need to create it.
2021-09-24 01:08:52,066 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Didn't find an existing storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb by UUID, checking for pools with duplicate paths
2021-09-24 01:08:52,192 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb from libvirt
2021-09-24 01:08:52,212 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:08:52,218 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:08:52,223 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create volume
3bf5af85-ca39-4e92-9149-1d7107983af0 (NetworkFilesystem) in pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b with size (2.44 GB) 2621440000
2021-09-24 01:09:41,425 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:0b231655) Trying to fetch storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 01:09:41,449 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-3:null) (logid:0b231655) Asking libvirt to refresh storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
...
2021-09-24 02:08:47,897 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:95f136df) Trying to fetch storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
2021-09-24 02:08:47,921 INFO [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-1:null) (logid:95f136df) Asking libvirt to refresh storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
2021-09-24 02:08:52,245 WARN [utils.script.Script] (Script-8:null)
(logid:) Interrupting script.
2021-09-24 02:08:52,247 WARN [utils.script.Script]
(agentRequest-Handler-5:null) (logid:3da47ae9) Timed out: qemu-img info
/mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
. Output is:
2021-09-24 02:08:52,248 ERROR [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:3da47ae9) Failed to fetch the information of file
/mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
the error was: timeout
So currently i am a bit stunned as i don't really know on how to move on from this point as everything else seems running / accessable.
Thanks in advance!
Re: SSCM and CSVM status starting till abort / libvirt: invalid
connection pointer in virConnectGetVersion
Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
Found my mistake..... and well.... i am ashamed that it was a firewalling
issue on the nfs server - never trust in description of services
anymore.... But now it works like expected!
Just for referrance how i was pointed twards looking at the network setup
again:
While googeling i came accross some quiet old issue-notices at the ACS
github referring the virConnectGetVersion, which where more or less
indirect related to my "problem". Thats why i started again looking into
the network.
Thanks for your supportt!
Am Fr., 24. Sept. 2021 um 15:09 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:
> here we are with some more inforamtion:
>
> Started the agent in debug mode and performed the process of zone creation
> / adding a host with the same results as beforehand. For this purpose i
> needed to use a different server. result is the same - constantly starting
> system VMs.
>
> Debug - resultet:
>
> (each 2 times)
> 2021-09-24 14:09:38,072 ERROR [kvm.resource.LibvirtComputingResource]
> (main:null) (logid:) uefi properties file not found due to: Unable to find
> file uefi.properties.
> 2021-09-24 14:09:38,637 ERROR [kvm.resource.LibvirtConnection]
> (Agent-Handler-1:null) (logid:) Connection with libvirtd is broken: invalid
> connection pointer in virConnectGetVersion
>
> one warning
> 2021-09-24 14:09:56,356 WARN [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:4f2b6925) Storage pool
> a93ac95f-6a93-30b3-b4ee-822203da20bb was not found running in libvirt. Need
> to create it.
> which is then created and
> 2021-09-24 14:09:56,388 DEBUG [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:4f2b6925) Succesfully refreshed pool
> a93ac95f-6a93-30b3-b4ee-822203da20bb Capacity: (1.7380 TB) 1910912974848
> Used: (375.13 MB) 393347072 Available: (1.7376 TB) 1910519627776
>
> Everything else is looking neatly.
> i posted the complete log at pastebin
>
> https://pastebin.com/Q5XGMnaz
>
> Currently my workflow for Hosts is:
> -install os
> -basic configuration (fqdn, ntp, networking & repositrories, )
> -install os updates
> -cloudstack agent installation
> - adding to host
>
> I installed all packages via the cloudstack ubuntu repository (
> http://download.cloudstack.org/ubuntu ) and use just all packages which
> will come with the cloudstack agent. - are they maybe outdated?
>
>
>
>
> Am Fr., 24. Sept. 2021 um 14:12 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:
>
>> Update
>>
>> @Wei ZHOU
>>
>> virsh list = empty
>> virsh pool-list = 3 entrys
>> - UID of Primary-Storage
>> - Guess the other 2 should be the once from the new system vm's - (is
>> there a way to verify?)
>>
>> @christian.c
>> Will do so and post updates
>>
>> Am Fr., 24. Sept. 2021 um 12:58 Uhr schrieb Wei ZHOU <
>> ustcweizhou@gmail.com>:
>>
>>> Hi,
>>>
>>> Please make sure libvirt is working well. for example,
>>>
>>> virsh list
>>> virsh pool-list
>>>
>>>
>>> -Wei
>>>
>>> On Fri, 24 Sept 2021 at 11:07, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>>
>>>> Hi,
>>>>
>>>> i am running into problems within my new setup - and i currently don't
>>>> know
>>>> where to look for to debug this.
>>>> Environment:
>>>> Newly installed
>>>> CS 4.15.2
>>>> Ubuntu 20.04 + KVM
>>>> 1x Management Server + 1 Host
>>>> Deploying Advanced Networking Zone
>>>>
>>>> Up to this point everything is running fine. Didn't found errors in the
>>>> log
>>>> files.
>>>> However: When enabling the zone the SSVM and CSVM are changeing to
>>>> started
>>>> but never reach "running".
>>>>
>>>> Taking a look into the agent.log i stumbled upon this ("..." =
>>>> repetion of
>>>> entries):
>>>>
>>>> 2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
>>>> SSL: Handshake done
>>>> 2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
>>>> Connected to 172.17.1.2:8250
>>>> 2021-09-24 01:01:55,373 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (Agent-Handler-1:null) (logid:) Attempting to create storage pool
>>>> 8362564e-11fd-4dd8-bae1-f90d53e52dab (Filesystem) in libvirt
>>>> 2021-09-24 01:01:55,379 ERROR [kvm.resource.LibvirtConnection]
>>>> (Agent-Handler-1:null) (logid:) Connection with libvirtd is broken:
>>>> invalid
>>>> connection pointer in virConnectGetVersion
>>>> 2021-09-24 01:01:55,381 WARN [kvm.storage.LibvirtStorageAdaptor]
>>>> (Agent-Handler-1:null) (logid:) Storage pool
>>>> 8362564e-11fd-4dd8-bae1-f90d53e52dab was not found running in libvirt.
>>>> Need
>>>> to create it.
>>>> 2021-09-24 01:01:55,381 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool
>>>> 8362564e-11fd-4dd8-bae1-f90d53e52dab by UUID, checking for pools with
>>>> duplicate paths
>>>> 2021-09-24 01:01:55,383 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (Agent-Handler-1:null) (logid:) Trying to fetch storage pool
>>>> 8362564e-11fd-4dd8-bae1-f90d53e52dab from libvirt
>>>> 2021-09-24 01:01:55,424 INFO [cloud.serializer.GsonHelper]
>>>> (Agent-Handler-1:null) (logid:) Default Builder inited.
>>>> 2021-09-24 01:01:55,470 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
>>>> (logid:) Proccess agent startup answer, agent id = 0
>>>> 2021-09-24 01:01:55,471 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
>>>> (logid:) Set agent id 0
>>>> 2021-09-24 01:01:55,476 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
>>>> (logid:) Startup Response Received: agent id = 0
>>>> 2021-09-24 01:01:55,701 INFO [cloud.agent.Agent]
>>>> (agentRequest-Handler-3:null) (logid:9e52178e) Processing agent ready
>>>> command, agent id = 1
>>>> 2021-09-24 01:01:55,702 INFO [cloud.agent.Agent]
>>>> (agentRequest-Handler-3:null) (logid:9e52178e) Set agent id 1
>>>> 2021-09-24 01:01:55,707 INFO [cloud.agent.Agent]
>>>> (agentRequest-Handler-3:null) (logid:9e52178e) Ready command is
>>>> processed
>>>> for agent id = 1
>>>> 2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
>>>> (agentRequest-Handler-4:null) (logid:9e52178e) Processing agent ready
>>>> command, agent id = 1
>>>> 2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
>>>> (agentRequest-Handler-4:null) (logid:9e52178e) Set agent id 1
>>>> 2021-09-24 01:01:55,808 INFO [cloud.agent.Agent]
>>>> (agentRequest-Handler-4:null) (logid:9e52178e) Processed new management
>>>> server list: 172.17.1.2@static
>>>> 2021-09-24 01:01:55,809 INFO [cloud.agent.Agent]
>>>> (agentRequest-Handler-4:null) (logid:9e52178e) Ready command is
>>>> processed
>>>> for agent id = 1
>>>> 2021-09-24 01:02:24,490 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:b81c6af6) Attempting to create
>>>> storage
>>>> pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b (NetworkFilesystem) in libvirt
>>>> 2021-09-24 01:02:24,510 WARN [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:b81c6af6) Storage pool
>>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b was not found running in libvirt.
>>>> Need
>>>> to create it.
>>>> 2021-09-24 01:02:24,510 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:b81c6af6) Didn't find an existing
>>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b by UUID, checking for
>>>> pools with duplicate paths
>>>> 2021-09-24 01:02:24,708 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:b81c6af6) Trying to fetch storage
>>>> pool
>>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>>> 2021-09-24 01:02:40,975 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-3:null) (logid:74acba6b) Trying to fetch storage
>>>> pool
>>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>>> 2021-09-24 01:02:41,001 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-3:null) (logid:74acba6b) Asking libvirt to refresh
>>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>>>> ...
>>>> 2021-09-24 01:08:41,382 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-1:null) (logid:94789a51) Trying to fetch storage
>>>> pool
>>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>>> 2021-09-24 01:08:41,405 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-1:null) (logid:94789a51) Asking libvirt to refresh
>>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>>>> 2021-09-24 01:08:52,046 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create
>>>> storage
>>>> pool a93ac95f-6a93-30b3-b4ee-822203da20bb (NetworkFilesystem) in libvirt
>>>> 2021-09-24 01:08:52,066 WARN [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Storage pool
>>>> a93ac95f-6a93-30b3-b4ee-822203da20bb was not found running in libvirt.
>>>> Need
>>>> to create it.
>>>> 2021-09-24 01:08:52,066 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Didn't find an existing
>>>> storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb by UUID, checking for
>>>> pools with duplicate paths
>>>> 2021-09-24 01:08:52,192 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage
>>>> pool
>>>> a93ac95f-6a93-30b3-b4ee-822203da20bb from libvirt
>>>> 2021-09-24 01:08:52,212 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage
>>>> pool
>>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>>> 2021-09-24 01:08:52,218 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage
>>>> pool
>>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>>> 2021-09-24 01:08:52,223 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create
>>>> volume
>>>> 3bf5af85-ca39-4e92-9149-1d7107983af0 (NetworkFilesystem) in pool
>>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b with size (2.44 GB) 2621440000
>>>> 2021-09-24 01:09:41,425 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-3:null) (logid:0b231655) Trying to fetch storage
>>>> pool
>>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>>> 2021-09-24 01:09:41,449 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-3:null) (logid:0b231655) Asking libvirt to refresh
>>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>>>> ...
>>>> 2021-09-24 02:08:47,897 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-1:null) (logid:95f136df) Trying to fetch storage
>>>> pool
>>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>>> 2021-09-24 02:08:47,921 INFO [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-1:null) (logid:95f136df) Asking libvirt to refresh
>>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>>>> 2021-09-24 02:08:52,245 WARN [utils.script.Script] (Script-8:null)
>>>> (logid:) Interrupting script.
>>>> 2021-09-24 02:08:52,247 WARN [utils.script.Script]
>>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Timed out: qemu-img info
>>>>
>>>> /mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
>>>> . Output is:
>>>> 2021-09-24 02:08:52,248 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Failed to fetch the
>>>> information of file
>>>>
>>>> /mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
>>>> the error was: timeout
>>>>
>>>> So currently i am a bit stunned as i don't really know on how to move on
>>>> from this point as everything else seems running / accessable.
>>>> Thanks in advance!
>>>>
>>>
Re: SSCM and CSVM status starting till abort / libvirt: invalid
connection pointer in virConnectGetVersion
Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
here we are with some more inforamtion:
Started the agent in debug mode and performed the process of zone creation
/ adding a host with the same results as beforehand. For this purpose i
needed to use a different server. result is the same - constantly starting
system VMs.
Debug - resultet:
(each 2 times)
2021-09-24 14:09:38,072 ERROR [kvm.resource.LibvirtComputingResource]
(main:null) (logid:) uefi properties file not found due to: Unable to find
file uefi.properties.
2021-09-24 14:09:38,637 ERROR [kvm.resource.LibvirtConnection]
(Agent-Handler-1:null) (logid:) Connection with libvirtd is broken: invalid
connection pointer in virConnectGetVersion
one warning
2021-09-24 14:09:56,356 WARN [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:4f2b6925) Storage pool
a93ac95f-6a93-30b3-b4ee-822203da20bb was not found running in libvirt. Need
to create it.
which is then created and
2021-09-24 14:09:56,388 DEBUG [kvm.storage.LibvirtStorageAdaptor]
(agentRequest-Handler-5:null) (logid:4f2b6925) Succesfully refreshed pool
a93ac95f-6a93-30b3-b4ee-822203da20bb Capacity: (1.7380 TB) 1910912974848
Used: (375.13 MB) 393347072 Available: (1.7376 TB) 1910519627776
Everything else is looking neatly.
i posted the complete log at pastebin
https://pastebin.com/Q5XGMnaz
Currently my workflow for Hosts is:
-install os
-basic configuration (fqdn, ntp, networking & repositrories, )
-install os updates
-cloudstack agent installation
- adding to host
I installed all packages via the cloudstack ubuntu repository (
http://download.cloudstack.org/ubuntu ) and use just all packages which
will come with the cloudstack agent. - are they maybe outdated?
Am Fr., 24. Sept. 2021 um 14:12 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:
> Update
>
> @Wei ZHOU
>
> virsh list = empty
> virsh pool-list = 3 entrys
> - UID of Primary-Storage
> - Guess the other 2 should be the once from the new system vm's - (is
> there a way to verify?)
>
> @christian.c
> Will do so and post updates
>
> Am Fr., 24. Sept. 2021 um 12:58 Uhr schrieb Wei ZHOU <
> ustcweizhou@gmail.com>:
>
>> Hi,
>>
>> Please make sure libvirt is working well. for example,
>>
>> virsh list
>> virsh pool-list
>>
>>
>> -Wei
>>
>> On Fri, 24 Sept 2021 at 11:07, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>
>>> Hi,
>>>
>>> i am running into problems within my new setup - and i currently don't
>>> know
>>> where to look for to debug this.
>>> Environment:
>>> Newly installed
>>> CS 4.15.2
>>> Ubuntu 20.04 + KVM
>>> 1x Management Server + 1 Host
>>> Deploying Advanced Networking Zone
>>>
>>> Up to this point everything is running fine. Didn't found errors in the
>>> log
>>> files.
>>> However: When enabling the zone the SSVM and CSVM are changeing to
>>> started
>>> but never reach "running".
>>>
>>> Taking a look into the agent.log i stumbled upon this ("..." = repetion
>>> of
>>> entries):
>>>
>>> 2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
>>> SSL: Handshake done
>>> 2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
>>> Connected to 172.17.1.2:8250
>>> 2021-09-24 01:01:55,373 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (Agent-Handler-1:null) (logid:) Attempting to create storage pool
>>> 8362564e-11fd-4dd8-bae1-f90d53e52dab (Filesystem) in libvirt
>>> 2021-09-24 01:01:55,379 ERROR [kvm.resource.LibvirtConnection]
>>> (Agent-Handler-1:null) (logid:) Connection with libvirtd is broken:
>>> invalid
>>> connection pointer in virConnectGetVersion
>>> 2021-09-24 01:01:55,381 WARN [kvm.storage.LibvirtStorageAdaptor]
>>> (Agent-Handler-1:null) (logid:) Storage pool
>>> 8362564e-11fd-4dd8-bae1-f90d53e52dab was not found running in libvirt.
>>> Need
>>> to create it.
>>> 2021-09-24 01:01:55,381 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool
>>> 8362564e-11fd-4dd8-bae1-f90d53e52dab by UUID, checking for pools with
>>> duplicate paths
>>> 2021-09-24 01:01:55,383 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (Agent-Handler-1:null) (logid:) Trying to fetch storage pool
>>> 8362564e-11fd-4dd8-bae1-f90d53e52dab from libvirt
>>> 2021-09-24 01:01:55,424 INFO [cloud.serializer.GsonHelper]
>>> (Agent-Handler-1:null) (logid:) Default Builder inited.
>>> 2021-09-24 01:01:55,470 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
>>> (logid:) Proccess agent startup answer, agent id = 0
>>> 2021-09-24 01:01:55,471 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
>>> (logid:) Set agent id 0
>>> 2021-09-24 01:01:55,476 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
>>> (logid:) Startup Response Received: agent id = 0
>>> 2021-09-24 01:01:55,701 INFO [cloud.agent.Agent]
>>> (agentRequest-Handler-3:null) (logid:9e52178e) Processing agent ready
>>> command, agent id = 1
>>> 2021-09-24 01:01:55,702 INFO [cloud.agent.Agent]
>>> (agentRequest-Handler-3:null) (logid:9e52178e) Set agent id 1
>>> 2021-09-24 01:01:55,707 INFO [cloud.agent.Agent]
>>> (agentRequest-Handler-3:null) (logid:9e52178e) Ready command is processed
>>> for agent id = 1
>>> 2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
>>> (agentRequest-Handler-4:null) (logid:9e52178e) Processing agent ready
>>> command, agent id = 1
>>> 2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
>>> (agentRequest-Handler-4:null) (logid:9e52178e) Set agent id 1
>>> 2021-09-24 01:01:55,808 INFO [cloud.agent.Agent]
>>> (agentRequest-Handler-4:null) (logid:9e52178e) Processed new management
>>> server list: 172.17.1.2@static
>>> 2021-09-24 01:01:55,809 INFO [cloud.agent.Agent]
>>> (agentRequest-Handler-4:null) (logid:9e52178e) Ready command is processed
>>> for agent id = 1
>>> 2021-09-24 01:02:24,490 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:b81c6af6) Attempting to create
>>> storage
>>> pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b (NetworkFilesystem) in libvirt
>>> 2021-09-24 01:02:24,510 WARN [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:b81c6af6) Storage pool
>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b was not found running in libvirt.
>>> Need
>>> to create it.
>>> 2021-09-24 01:02:24,510 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:b81c6af6) Didn't find an existing
>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b by UUID, checking for
>>> pools with duplicate paths
>>> 2021-09-24 01:02:24,708 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:b81c6af6) Trying to fetch storage
>>> pool
>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>> 2021-09-24 01:02:40,975 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-3:null) (logid:74acba6b) Trying to fetch storage
>>> pool
>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>> 2021-09-24 01:02:41,001 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-3:null) (logid:74acba6b) Asking libvirt to refresh
>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>>> ...
>>> 2021-09-24 01:08:41,382 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-1:null) (logid:94789a51) Trying to fetch storage
>>> pool
>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>> 2021-09-24 01:08:41,405 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-1:null) (logid:94789a51) Asking libvirt to refresh
>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>>> 2021-09-24 01:08:52,046 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create
>>> storage
>>> pool a93ac95f-6a93-30b3-b4ee-822203da20bb (NetworkFilesystem) in libvirt
>>> 2021-09-24 01:08:52,066 WARN [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Storage pool
>>> a93ac95f-6a93-30b3-b4ee-822203da20bb was not found running in libvirt.
>>> Need
>>> to create it.
>>> 2021-09-24 01:08:52,066 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Didn't find an existing
>>> storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb by UUID, checking for
>>> pools with duplicate paths
>>> 2021-09-24 01:08:52,192 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage
>>> pool
>>> a93ac95f-6a93-30b3-b4ee-822203da20bb from libvirt
>>> 2021-09-24 01:08:52,212 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage
>>> pool
>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>> 2021-09-24 01:08:52,218 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage
>>> pool
>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>> 2021-09-24 01:08:52,223 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create
>>> volume
>>> 3bf5af85-ca39-4e92-9149-1d7107983af0 (NetworkFilesystem) in pool
>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b with size (2.44 GB) 2621440000
>>> 2021-09-24 01:09:41,425 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-3:null) (logid:0b231655) Trying to fetch storage
>>> pool
>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>> 2021-09-24 01:09:41,449 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-3:null) (logid:0b231655) Asking libvirt to refresh
>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>>> ...
>>> 2021-09-24 02:08:47,897 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-1:null) (logid:95f136df) Trying to fetch storage
>>> pool
>>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>>> 2021-09-24 02:08:47,921 INFO [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-1:null) (logid:95f136df) Asking libvirt to refresh
>>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>>> 2021-09-24 02:08:52,245 WARN [utils.script.Script] (Script-8:null)
>>> (logid:) Interrupting script.
>>> 2021-09-24 02:08:52,247 WARN [utils.script.Script]
>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Timed out: qemu-img info
>>>
>>> /mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
>>> . Output is:
>>> 2021-09-24 02:08:52,248 ERROR [kvm.storage.LibvirtStorageAdaptor]
>>> (agentRequest-Handler-5:null) (logid:3da47ae9) Failed to fetch the
>>> information of file
>>>
>>> /mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
>>> the error was: timeout
>>>
>>> So currently i am a bit stunned as i don't really know on how to move on
>>> from this point as everything else seems running / accessable.
>>> Thanks in advance!
>>>
>>
Re: SSCM and CSVM status starting till abort / libvirt: invalid
connection pointer in virConnectGetVersion
Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
Update
@Wei ZHOU
virsh list = empty
virsh pool-list = 3 entrys
- UID of Primary-Storage
- Guess the other 2 should be the once from the new system vm's - (is
there a way to verify?)
@christian.c
Will do so and post updates
Am Fr., 24. Sept. 2021 um 12:58 Uhr schrieb Wei ZHOU <ustcweizhou@gmail.com
>:
> Hi,
>
> Please make sure libvirt is working well. for example,
>
> virsh list
> virsh pool-list
>
>
> -Wei
>
> On Fri, 24 Sept 2021 at 11:07, Vash_X@gmx.de <Va...@gmx.de> wrote:
>
>> Hi,
>>
>> i am running into problems within my new setup - and i currently don't
>> know
>> where to look for to debug this.
>> Environment:
>> Newly installed
>> CS 4.15.2
>> Ubuntu 20.04 + KVM
>> 1x Management Server + 1 Host
>> Deploying Advanced Networking Zone
>>
>> Up to this point everything is running fine. Didn't found errors in the
>> log
>> files.
>> However: When enabling the zone the SSVM and CSVM are changeing to started
>> but never reach "running".
>>
>> Taking a look into the agent.log i stumbled upon this ("..." = repetion
>> of
>> entries):
>>
>> 2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
>> SSL: Handshake done
>> 2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
>> Connected to 172.17.1.2:8250
>> 2021-09-24 01:01:55,373 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (Agent-Handler-1:null) (logid:) Attempting to create storage pool
>> 8362564e-11fd-4dd8-bae1-f90d53e52dab (Filesystem) in libvirt
>> 2021-09-24 01:01:55,379 ERROR [kvm.resource.LibvirtConnection]
>> (Agent-Handler-1:null) (logid:) Connection with libvirtd is broken:
>> invalid
>> connection pointer in virConnectGetVersion
>> 2021-09-24 01:01:55,381 WARN [kvm.storage.LibvirtStorageAdaptor]
>> (Agent-Handler-1:null) (logid:) Storage pool
>> 8362564e-11fd-4dd8-bae1-f90d53e52dab was not found running in libvirt.
>> Need
>> to create it.
>> 2021-09-24 01:01:55,381 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool
>> 8362564e-11fd-4dd8-bae1-f90d53e52dab by UUID, checking for pools with
>> duplicate paths
>> 2021-09-24 01:01:55,383 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (Agent-Handler-1:null) (logid:) Trying to fetch storage pool
>> 8362564e-11fd-4dd8-bae1-f90d53e52dab from libvirt
>> 2021-09-24 01:01:55,424 INFO [cloud.serializer.GsonHelper]
>> (Agent-Handler-1:null) (logid:) Default Builder inited.
>> 2021-09-24 01:01:55,470 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
>> (logid:) Proccess agent startup answer, agent id = 0
>> 2021-09-24 01:01:55,471 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
>> (logid:) Set agent id 0
>> 2021-09-24 01:01:55,476 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
>> (logid:) Startup Response Received: agent id = 0
>> 2021-09-24 01:01:55,701 INFO [cloud.agent.Agent]
>> (agentRequest-Handler-3:null) (logid:9e52178e) Processing agent ready
>> command, agent id = 1
>> 2021-09-24 01:01:55,702 INFO [cloud.agent.Agent]
>> (agentRequest-Handler-3:null) (logid:9e52178e) Set agent id 1
>> 2021-09-24 01:01:55,707 INFO [cloud.agent.Agent]
>> (agentRequest-Handler-3:null) (logid:9e52178e) Ready command is processed
>> for agent id = 1
>> 2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
>> (agentRequest-Handler-4:null) (logid:9e52178e) Processing agent ready
>> command, agent id = 1
>> 2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
>> (agentRequest-Handler-4:null) (logid:9e52178e) Set agent id 1
>> 2021-09-24 01:01:55,808 INFO [cloud.agent.Agent]
>> (agentRequest-Handler-4:null) (logid:9e52178e) Processed new management
>> server list: 172.17.1.2@static
>> 2021-09-24 01:01:55,809 INFO [cloud.agent.Agent]
>> (agentRequest-Handler-4:null) (logid:9e52178e) Ready command is processed
>> for agent id = 1
>> 2021-09-24 01:02:24,490 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:b81c6af6) Attempting to create
>> storage
>> pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b (NetworkFilesystem) in libvirt
>> 2021-09-24 01:02:24,510 WARN [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:b81c6af6) Storage pool
>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b was not found running in libvirt.
>> Need
>> to create it.
>> 2021-09-24 01:02:24,510 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:b81c6af6) Didn't find an existing
>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b by UUID, checking for
>> pools with duplicate paths
>> 2021-09-24 01:02:24,708 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:b81c6af6) Trying to fetch storage
>> pool
>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>> 2021-09-24 01:02:40,975 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-3:null) (logid:74acba6b) Trying to fetch storage
>> pool
>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>> 2021-09-24 01:02:41,001 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-3:null) (logid:74acba6b) Asking libvirt to refresh
>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>> ...
>> 2021-09-24 01:08:41,382 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-1:null) (logid:94789a51) Trying to fetch storage
>> pool
>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>> 2021-09-24 01:08:41,405 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-1:null) (logid:94789a51) Asking libvirt to refresh
>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>> 2021-09-24 01:08:52,046 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create
>> storage
>> pool a93ac95f-6a93-30b3-b4ee-822203da20bb (NetworkFilesystem) in libvirt
>> 2021-09-24 01:08:52,066 WARN [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:3da47ae9) Storage pool
>> a93ac95f-6a93-30b3-b4ee-822203da20bb was not found running in libvirt.
>> Need
>> to create it.
>> 2021-09-24 01:08:52,066 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:3da47ae9) Didn't find an existing
>> storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb by UUID, checking for
>> pools with duplicate paths
>> 2021-09-24 01:08:52,192 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage
>> pool
>> a93ac95f-6a93-30b3-b4ee-822203da20bb from libvirt
>> 2021-09-24 01:08:52,212 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage
>> pool
>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>> 2021-09-24 01:08:52,218 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage
>> pool
>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>> 2021-09-24 01:08:52,223 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create volume
>> 3bf5af85-ca39-4e92-9149-1d7107983af0 (NetworkFilesystem) in pool
>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b with size (2.44 GB) 2621440000
>> 2021-09-24 01:09:41,425 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-3:null) (logid:0b231655) Trying to fetch storage
>> pool
>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>> 2021-09-24 01:09:41,449 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-3:null) (logid:0b231655) Asking libvirt to refresh
>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>> ...
>> 2021-09-24 02:08:47,897 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-1:null) (logid:95f136df) Trying to fetch storage
>> pool
>> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
>> 2021-09-24 02:08:47,921 INFO [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-1:null) (logid:95f136df) Asking libvirt to refresh
>> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
>> 2021-09-24 02:08:52,245 WARN [utils.script.Script] (Script-8:null)
>> (logid:) Interrupting script.
>> 2021-09-24 02:08:52,247 WARN [utils.script.Script]
>> (agentRequest-Handler-5:null) (logid:3da47ae9) Timed out: qemu-img info
>>
>> /mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
>> . Output is:
>> 2021-09-24 02:08:52,248 ERROR [kvm.storage.LibvirtStorageAdaptor]
>> (agentRequest-Handler-5:null) (logid:3da47ae9) Failed to fetch the
>> information of file
>>
>> /mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
>> the error was: timeout
>>
>> So currently i am a bit stunned as i don't really know on how to move on
>> from this point as everything else seems running / accessable.
>> Thanks in advance!
>>
>
Re: SSCM and CSVM status starting till abort / libvirt: invalid
connection pointer in virConnectGetVersion
Posted by Wei ZHOU <us...@gmail.com>.
Hi,
Please make sure libvirt is working well. for example,
virsh list
virsh pool-list
-Wei
On Fri, 24 Sept 2021 at 11:07, Vash_X@gmx.de <Va...@gmx.de> wrote:
> Hi,
>
> i am running into problems within my new setup - and i currently don't know
> where to look for to debug this.
> Environment:
> Newly installed
> CS 4.15.2
> Ubuntu 20.04 + KVM
> 1x Management Server + 1 Host
> Deploying Advanced Networking Zone
>
> Up to this point everything is running fine. Didn't found errors in the log
> files.
> However: When enabling the zone the SSVM and CSVM are changeing to started
> but never reach "running".
>
> Taking a look into the agent.log i stumbled upon this ("..." = repetion of
> entries):
>
> 2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
> SSL: Handshake done
> 2021-09-24 01:01:55,311 INFO [utils.nio.NioClient] (main:null) (logid:)
> Connected to 172.17.1.2:8250
> 2021-09-24 01:01:55,373 INFO [kvm.storage.LibvirtStorageAdaptor]
> (Agent-Handler-1:null) (logid:) Attempting to create storage pool
> 8362564e-11fd-4dd8-bae1-f90d53e52dab (Filesystem) in libvirt
> 2021-09-24 01:01:55,379 ERROR [kvm.resource.LibvirtConnection]
> (Agent-Handler-1:null) (logid:) Connection with libvirtd is broken: invalid
> connection pointer in virConnectGetVersion
> 2021-09-24 01:01:55,381 WARN [kvm.storage.LibvirtStorageAdaptor]
> (Agent-Handler-1:null) (logid:) Storage pool
> 8362564e-11fd-4dd8-bae1-f90d53e52dab was not found running in libvirt. Need
> to create it.
> 2021-09-24 01:01:55,381 INFO [kvm.storage.LibvirtStorageAdaptor]
> (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool
> 8362564e-11fd-4dd8-bae1-f90d53e52dab by UUID, checking for pools with
> duplicate paths
> 2021-09-24 01:01:55,383 INFO [kvm.storage.LibvirtStorageAdaptor]
> (Agent-Handler-1:null) (logid:) Trying to fetch storage pool
> 8362564e-11fd-4dd8-bae1-f90d53e52dab from libvirt
> 2021-09-24 01:01:55,424 INFO [cloud.serializer.GsonHelper]
> (Agent-Handler-1:null) (logid:) Default Builder inited.
> 2021-09-24 01:01:55,470 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
> (logid:) Proccess agent startup answer, agent id = 0
> 2021-09-24 01:01:55,471 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
> (logid:) Set agent id 0
> 2021-09-24 01:01:55,476 INFO [cloud.agent.Agent] (Agent-Handler-2:null)
> (logid:) Startup Response Received: agent id = 0
> 2021-09-24 01:01:55,701 INFO [cloud.agent.Agent]
> (agentRequest-Handler-3:null) (logid:9e52178e) Processing agent ready
> command, agent id = 1
> 2021-09-24 01:01:55,702 INFO [cloud.agent.Agent]
> (agentRequest-Handler-3:null) (logid:9e52178e) Set agent id 1
> 2021-09-24 01:01:55,707 INFO [cloud.agent.Agent]
> (agentRequest-Handler-3:null) (logid:9e52178e) Ready command is processed
> for agent id = 1
> 2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
> (agentRequest-Handler-4:null) (logid:9e52178e) Processing agent ready
> command, agent id = 1
> 2021-09-24 01:01:55,807 INFO [cloud.agent.Agent]
> (agentRequest-Handler-4:null) (logid:9e52178e) Set agent id 1
> 2021-09-24 01:01:55,808 INFO [cloud.agent.Agent]
> (agentRequest-Handler-4:null) (logid:9e52178e) Processed new management
> server list: 172.17.1.2@static
> 2021-09-24 01:01:55,809 INFO [cloud.agent.Agent]
> (agentRequest-Handler-4:null) (logid:9e52178e) Ready command is processed
> for agent id = 1
> 2021-09-24 01:02:24,490 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:b81c6af6) Attempting to create storage
> pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b (NetworkFilesystem) in libvirt
> 2021-09-24 01:02:24,510 WARN [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:b81c6af6) Storage pool
> 8bc1feaa-a099-3590-aa2b-2d12df0e242b was not found running in libvirt. Need
> to create it.
> 2021-09-24 01:02:24,510 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:b81c6af6) Didn't find an existing
> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b by UUID, checking for
> pools with duplicate paths
> 2021-09-24 01:02:24,708 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:b81c6af6) Trying to fetch storage pool
> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
> 2021-09-24 01:02:40,975 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-3:null) (logid:74acba6b) Trying to fetch storage pool
> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
> 2021-09-24 01:02:41,001 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-3:null) (logid:74acba6b) Asking libvirt to refresh
> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
> ...
> 2021-09-24 01:08:41,382 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-1:null) (logid:94789a51) Trying to fetch storage pool
> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
> 2021-09-24 01:08:41,405 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-1:null) (logid:94789a51) Asking libvirt to refresh
> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
> 2021-09-24 01:08:52,046 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create storage
> pool a93ac95f-6a93-30b3-b4ee-822203da20bb (NetworkFilesystem) in libvirt
> 2021-09-24 01:08:52,066 WARN [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:3da47ae9) Storage pool
> a93ac95f-6a93-30b3-b4ee-822203da20bb was not found running in libvirt. Need
> to create it.
> 2021-09-24 01:08:52,066 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:3da47ae9) Didn't find an existing
> storage pool a93ac95f-6a93-30b3-b4ee-822203da20bb by UUID, checking for
> pools with duplicate paths
> 2021-09-24 01:08:52,192 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool
> a93ac95f-6a93-30b3-b4ee-822203da20bb from libvirt
> 2021-09-24 01:08:52,212 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool
> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
> 2021-09-24 01:08:52,218 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:3da47ae9) Trying to fetch storage pool
> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
> 2021-09-24 01:08:52,223 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:3da47ae9) Attempting to create volume
> 3bf5af85-ca39-4e92-9149-1d7107983af0 (NetworkFilesystem) in pool
> 8bc1feaa-a099-3590-aa2b-2d12df0e242b with size (2.44 GB) 2621440000
> 2021-09-24 01:09:41,425 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-3:null) (logid:0b231655) Trying to fetch storage pool
> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
> 2021-09-24 01:09:41,449 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-3:null) (logid:0b231655) Asking libvirt to refresh
> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
> ...
> 2021-09-24 02:08:47,897 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-1:null) (logid:95f136df) Trying to fetch storage pool
> 8bc1feaa-a099-3590-aa2b-2d12df0e242b from libvirt
> 2021-09-24 02:08:47,921 INFO [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-1:null) (logid:95f136df) Asking libvirt to refresh
> storage pool 8bc1feaa-a099-3590-aa2b-2d12df0e242b
> 2021-09-24 02:08:52,245 WARN [utils.script.Script] (Script-8:null)
> (logid:) Interrupting script.
> 2021-09-24 02:08:52,247 WARN [utils.script.Script]
> (agentRequest-Handler-5:null) (logid:3da47ae9) Timed out: qemu-img info
>
> /mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
> . Output is:
> 2021-09-24 02:08:52,248 ERROR [kvm.storage.LibvirtStorageAdaptor]
> (agentRequest-Handler-5:null) (logid:3da47ae9) Failed to fetch the
> information of file
>
> /mnt/a93ac95f-6a93-30b3-b4ee-822203da20bb/3bf5af85-ca39-4e92-9149-1d7107983af0.qcow2
> the error was: timeout
>
> So currently i am a bit stunned as i don't really know on how to move on
> from this point as everything else seems running / accessable.
> Thanks in advance!
>