You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Fariborz Navidan <md...@gmail.com> on 2024/07/12 21:19:51 UTC
Agent keeps restarting
Hello Guys,
I have installed CS 4.18 management and agent on an AlmaLinux 9 machine. I
have not yet added any zone or any infrastructure because cloudstack-agent
service keeps auto-restarting. Below is the latest content of agent.log
file. It doesn't contain any error. It just keeps restarting.
I need to ensure the agent is running to proceed with creating zone and
adding KVM host. Please help.
Thanks in advance.
---
[root@pl-kvm1 agent]# cat agent.log
2024-07-12 23:15:18,258 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:15:18,260 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:15:18,261 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:15:28,779 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:15:28,781 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:15:28,782 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:15:39,281 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:15:39,283 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:15:39,284 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:15:49,779 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:15:49,781 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:15:49,782 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:00,281 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:00,283 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:00,283 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:10,782 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:10,784 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:10,784 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:21,275 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:21,277 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:21,278 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:31,773 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:31,775 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:31,775 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:42,275 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:42,277 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:42,278 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:52,774 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:52,776 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:52,777 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:17:03,273 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:17:03,275 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:17:03,276 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:17:13,814 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:17:13,816 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:17:13,816 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:17:24,279 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:17:24,281 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:17:24,282 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:17:34,777 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:17:34,779 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:17:34,780 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
[root@pl-kvm1 agent]#
Re: error: No more available PCI slot
Posted by Alex Dietrich <ad...@ussignal.com.INVALID>.
Hi Piotr,
When attempting to add the NIC did you stop the instance?
I've found to add additional volumes I had to stop the instance to avoid this error. That being said, I've definitely added a NIC while the instance is running.
Thanks,
Alex
[photo]<http://www.ussignal.com>
Alex Dietrich
Senior Network Engineer, US Signal
616-233-5094<tel:616-233-5094> | www.ussignal.com<https://www.ussignal.com> | adietrich@ussignal.com<ma...@ussignal.com>
201 Ionia Ave SW, Grand Rapids, MI 49503<https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503>
[linkedin]<https://www.linkedin.com/company/us-signal/>
[facebook]<https://www.facebook.com/ussignalcom/>
[youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw>
IMPORTANT: The contents of this email are confidential. Information is intended for the named recipient(s) only. If you have received this email by mistake, please notify the sender immediately and do not disclose the contents to anyone or make copies thereof.
[__tpx__]
________________________________
From: Piotr Pisz <pi...@piszki.pl>
Sent: Sunday, July 14, 2024 4:38:02 PM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: error: No more available PCI slot
EXTERNAL
Hi,
I have a little problem, I'm trying to add an additional network card to
the VM and I get the message below. This VM is running docker and
several services. To other VMs without docker I can add a second NIC
without any problem. The environment is KVM U22 and VM U24 CS 4.19
advanced zone without security groups.
Maybe someone has encountered something similar?
Regards,
Piotr
2024-07-14 22:26:21,310 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-7:null) (logid:) Seq 4-3337448798858281554:
Processing: { Ans: , MgmtId: 94770532512064, via: 4, Ver: v1, Flags:
110, [{"com.cloud.agent.api.PlugNicAnswer":{"result":"false","details":"
Plug Nic failed due to org.libvirt.LibvirtException: internal error: No
more available PCI slots","wait":"0","bypassHostMaintenance":"false"}}]
}
2024-07-14 22:26:21,310 DEBUG [c.c.a.m.AgentAttache]
(AgentManager-Handler-7:null) (logid:) Seq 4-3337448798858281554: No
more commands found
2024-07-14 22:26:21,310 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Seq 4-3337448798858281554: Received: { Ans: , MgmtId:
94770532512064, via: 4(sdb.dco.webdisk.io), Ver: v1, Flags: 110, {
PlugNicAnswer } }
2024-07-14 22:26:21,310 WARN [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Unable to plug nic for vm i-4-24-VM
2024-07-14 22:26:21,311 WARN [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Failed to plug nic to the vm VM instance
{"id":24,"instanceName":"i-4-24-VM","type":"User","uuid":"a1276a23-44ab-4da3-b6d9-f86d8014cc04"}
in network Network {"id": 208, "name": "Interconnect-VLAN", "uuid":
"1887531b-8938-4a1f-869f-8ff8b344211e", "networkofferingid": 17}
2024-07-14 22:26:21,311 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Removing nic NicProfile
{"broadcastUri":"vlan:\/\/105","iPv4Address":null,"id":57,"reservationId":null,"vmId":24}
from vm VM instance
{"id":24,"instanceName":"i-4-24-VM","type":"User","uuid":"a1276a23-44ab-4da3-b6d9-f86d8014cc04"}
as nic plug failed on the backend
2024-07-14 22:26:21,319 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Service SecurityGroup is not supported in the network
id=208
2024-07-14 22:26:21,326 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Changing active number of nics for network id=208 on -1
2024-07-14 22:26:21,360 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Service SecurityGroup is not supported in the network
id=208
2024-07-14 22:26:21,373 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Removed nic id=57
2024-07-14 22:26:21,375 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Revoving nic secondary ip entry ...
2024-07-14 22:26:21,376 DEBUG [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Done executing VM work job:
com.cloud.vm.VmWorkAddVmToNetwork{"networkId":208,"requstedNicProfile":{"id":0,"networkId":0,"vmId":0,"macAddress":"02:01:00:d0:00:08","mode":"Dhcp","format":"Ip4","isolationUri":"vlan://105","broadcastUri":"vlan://105","strategy":"Start","defaultNic":false,"isSecurityGroupEnabled":false,"iPv4Dns1":"8.8.8.8"},"userId":2,"accountId":2,"vmId":24,"handlerName":"VirtualMachineManagerImpl"}
2024-07-14 22:26:21,378 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Complete async job-256, jobStatus: SUCCEEDED,
resultCode: 0, result: null
2024-07-14 22:26:21,380 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Publish async job-256 complete on message bus
2024-07-14 22:26:21,380 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Wake up jobs related to job-256
2024-07-14 22:26:21,380 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Update db status for job-256
2024-07-14 22:26:21,382 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Wake up jobs joined with job-256 and disjoin all
subjobs created from job- 256
2024-07-14 22:26:21,398 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256) (logid:e94b73b2)
Done with run of VM work job: com.cloud.vm.VmWorkAddVmToNetwork for VM
24, job origin: 255
2024-07-14 22:26:21,398 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256) (logid:e94b73b2)
Done executing com.cloud.vm.VmWorkAddVmToNetwork for job-256
2024-07-14 22:26:21,400 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256) (logid:e94b73b2)
Remove job-256 from job monitoring
2024-07-14 22:26:21,442 WARN [c.c.v.VirtualMachineManagerImpl]
(API-Job-Executor-39:ctx-e93b4cde job-255 ctx-90fb667e) (logid:e94b73b2)
Could not get a nic with Network {"id": 208, "name":
"Interconnect-VLAN", "uuid": "1887531b-8938-4a1f-869f-8ff8b344211e",
"networkofferingid": 17}
2024-07-14 22:26:21,455 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-39:ctx-e93b4cde job-255) (logid:e94b73b2) Unexpected
exception while executing
org.apache.cloudstack.api.command.admin.vm.AddNicToVMCmdByAdmin
java.lang.RuntimeException: null job execution result
at
com.cloud.vm.VirtualMachineManagerImpl.addVmToNetwork(VirtualMachineManagerImpl.java:4009)
at
com.cloud.vm.UserVmManagerImpl.addNicToVirtualMachine(UserVmManagerImpl.java:1455)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:52)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
at com.sun.proxy.$Proxy199.addNicToVirtualMachine(Unknown
Source)
at
org.apache.cloudstack.api.command.user.vm.AddNicToVMCmd.execute(AddNicToVMCmd.java:173)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:172)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:112)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:654)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:602)
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2024-07-14 22:26:21,458 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-39:ctx-e93b4cde job-255) (logid:e94b73b2) Complete
async job-255, jobStatus: FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"null
job execution result"}
error: No more available PCI slot
Posted by Piotr Pisz <pi...@piszki.pl>.
Hi,
I have a little problem, I'm trying to add an additional network card to
the VM and I get the message below. This VM is running docker and
several services. To other VMs without docker I can add a second NIC
without any problem. The environment is KVM U22 and VM U24 CS 4.19
advanced zone without security groups.
Maybe someone has encountered something similar?
Regards,
Piotr
2024-07-14 22:26:21,310 DEBUG [c.c.a.t.Request]
(AgentManager-Handler-7:null) (logid:) Seq 4-3337448798858281554:
Processing: { Ans: , MgmtId: 94770532512064, via: 4, Ver: v1, Flags:
110, [{"com.cloud.agent.api.PlugNicAnswer":{"result":"false","details":"
Plug Nic failed due to org.libvirt.LibvirtException: internal error: No
more available PCI slots","wait":"0","bypassHostMaintenance":"false"}}]
}
2024-07-14 22:26:21,310 DEBUG [c.c.a.m.AgentAttache]
(AgentManager-Handler-7:null) (logid:) Seq 4-3337448798858281554: No
more commands found
2024-07-14 22:26:21,310 DEBUG [c.c.a.t.Request]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Seq 4-3337448798858281554: Received: { Ans: , MgmtId:
94770532512064, via: 4(sdb.dco.webdisk.io), Ver: v1, Flags: 110, {
PlugNicAnswer } }
2024-07-14 22:26:21,310 WARN [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Unable to plug nic for vm i-4-24-VM
2024-07-14 22:26:21,311 WARN [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Failed to plug nic to the vm VM instance
{"id":24,"instanceName":"i-4-24-VM","type":"User","uuid":"a1276a23-44ab-4da3-b6d9-f86d8014cc04"}
in network Network {"id": 208, "name": "Interconnect-VLAN", "uuid":
"1887531b-8938-4a1f-869f-8ff8b344211e", "networkofferingid": 17}
2024-07-14 22:26:21,311 DEBUG [c.c.v.VirtualMachineManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Removing nic NicProfile
{"broadcastUri":"vlan:\/\/105","iPv4Address":null,"id":57,"reservationId":null,"vmId":24}
from vm VM instance
{"id":24,"instanceName":"i-4-24-VM","type":"User","uuid":"a1276a23-44ab-4da3-b6d9-f86d8014cc04"}
as nic plug failed on the backend
2024-07-14 22:26:21,319 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Service SecurityGroup is not supported in the network
id=208
2024-07-14 22:26:21,326 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Changing active number of nics for network id=208 on -1
2024-07-14 22:26:21,360 DEBUG [c.c.n.NetworkModelImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Service SecurityGroup is not supported in the network
id=208
2024-07-14 22:26:21,373 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Removed nic id=57
2024-07-14 22:26:21,375 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Revoving nic secondary ip entry ...
2024-07-14 22:26:21,376 DEBUG [c.c.v.VmWorkJobHandlerProxy]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Done executing VM work job:
com.cloud.vm.VmWorkAddVmToNetwork{"networkId":208,"requstedNicProfile":{"id":0,"networkId":0,"vmId":0,"macAddress":"02:01:00:d0:00:08","mode":"Dhcp","format":"Ip4","isolationUri":"vlan://105","broadcastUri":"vlan://105","strategy":"Start","defaultNic":false,"isSecurityGroupEnabled":false,"iPv4Dns1":"8.8.8.8"},"userId":2,"accountId":2,"vmId":24,"handlerName":"VirtualMachineManagerImpl"}
2024-07-14 22:26:21,378 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Complete async job-256, jobStatus: SUCCEEDED,
resultCode: 0, result: null
2024-07-14 22:26:21,380 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Publish async job-256 complete on message bus
2024-07-14 22:26:21,380 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Wake up jobs related to job-256
2024-07-14 22:26:21,380 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Update db status for job-256
2024-07-14 22:26:21,382 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256 ctx-f0606081)
(logid:e94b73b2) Wake up jobs joined with job-256 and disjoin all
subjobs created from job- 256
2024-07-14 22:26:21,398 DEBUG [c.c.v.VmWorkJobDispatcher]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256) (logid:e94b73b2)
Done with run of VM work job: com.cloud.vm.VmWorkAddVmToNetwork for VM
24, job origin: 255
2024-07-14 22:26:21,398 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256) (logid:e94b73b2)
Done executing com.cloud.vm.VmWorkAddVmToNetwork for job-256
2024-07-14 22:26:21,400 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Work-Job-Executor-21:ctx-0720514a job-255/job-256) (logid:e94b73b2)
Remove job-256 from job monitoring
2024-07-14 22:26:21,442 WARN [c.c.v.VirtualMachineManagerImpl]
(API-Job-Executor-39:ctx-e93b4cde job-255 ctx-90fb667e) (logid:e94b73b2)
Could not get a nic with Network {"id": 208, "name":
"Interconnect-VLAN", "uuid": "1887531b-8938-4a1f-869f-8ff8b344211e",
"networkofferingid": 17}
2024-07-14 22:26:21,455 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-39:ctx-e93b4cde job-255) (logid:e94b73b2) Unexpected
exception while executing
org.apache.cloudstack.api.command.admin.vm.AddNicToVMCmdByAdmin
java.lang.RuntimeException: null job execution result
at
com.cloud.vm.VirtualMachineManagerImpl.addVmToNetwork(VirtualMachineManagerImpl.java:4009)
at
com.cloud.vm.UserVmManagerImpl.addNicToVirtualMachine(UserVmManagerImpl.java:1455)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:566)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:52)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
at com.sun.proxy.$Proxy199.addNicToVirtualMachine(Unknown
Source)
at
org.apache.cloudstack.api.command.user.vm.AddNicToVMCmd.execute(AddNicToVMCmd.java:173)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:172)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:112)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:654)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:602)
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
2024-07-14 22:26:21,458 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-39:ctx-e93b4cde job-255) (logid:e94b73b2) Complete
async job-255, jobStatus: FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":"530","errortext":"null
job execution result"}
Re: Agent keeps restarting
Posted by Fariborz Navidan <md...@gmail.com>.
Thank you Alex.
I have another question. If I have a public IP address range configured,
will guest VMs be assigned a public IP when they are deployed? I am asking
this in previous versions I was using shared guest network to assign public
IP addresses to VMs.
Thanks.
On Sat, 13 Jul 2024, 01:36 Alex Dietrich, <ad...@ussignal.com.invalid>
wrote:
> Hi Fariborz,
>
> This is an expected behavior. CloudStack Management will perform several
> modifications to the host that is running the agent when the host is added
> to a zone and pod. At this point, the agent will start to interact
> normally. There isn't anything for the agent to do at this point without
> any configured management server to interact with.
>
>
> * Alex
>
> [photo]<http://www.ussignal.com>
>
> Alex Dietrich
> Senior Network Engineer, US Signal
>
> 616-233-5094<tel:616-233-5094> | www.ussignal.com<
> https://www.ussignal.com> | adietrich@ussignal.com<mailto:
> adietrich@ussignal.com>
>
> 201 Ionia Ave SW, Grand Rapids, MI 49503<
> https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503
> >
>
> [linkedin]<https://www.linkedin.com/company/us-signal/>
>
> [facebook]<https://www.facebook.com/ussignalcom/>
>
> [youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw>
>
> IMPORTANT: The contents of this email are confidential. Information is
> intended for the named recipient(s) only. If you have received this email
> by mistake, please notify the sender immediately and do not disclose the
> contents to anyone or make copies thereof.
>
>
> [__tpx__]
>
> ________________________________
> From: Fariborz Navidan <md...@gmail.com>
> Sent: Friday, July 12, 2024 5:19:51 PM
> To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
> Subject: Agent keeps restarting
>
> EXTERNAL
>
> Hello Guys,
>
> I have installed CS 4.18 management and agent on an AlmaLinux 9 machine. I
> have not yet added any zone or any infrastructure because cloudstack-agent
> service keeps auto-restarting. Below is the latest content of agent.log
> file. It doesn't contain any error. It just keeps restarting.
>
> I need to ensure the agent is running to proceed with creating zone and
> adding KVM host. Please help.
>
> Thanks in advance.
>
> ---
> [root@pl-kvm1 agent]# cat agent.log
>
> 2024-07-12 23:15:18,258 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:15:18,260 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:15:18,261 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:15:28,779 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:15:28,781 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:15:28,782 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:15:39,281 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:15:39,283 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:15:39,284 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:15:49,779 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:15:49,781 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:15:49,782 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:16:00,281 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:16:00,283 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:16:00,283 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:16:10,782 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:16:10,784 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:16:10,784 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:16:21,275 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:16:21,277 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:16:21,278 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:16:31,773 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:16:31,775 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:16:31,775 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:16:42,275 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:16:42,277 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:16:42,278 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:16:52,774 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:16:52,776 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:16:52,777 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:17:03,273 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:17:03,275 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:17:03,276 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:17:13,814 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:17:13,816 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:17:13,816 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:17:24,279 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:17:24,281 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:17:24,282 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> 2024-07-12 23:17:34,777 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Agent started
> 2024-07-12 23:17:34,779 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> Implementation Version is 4.18.2.0
> 2024-07-12 23:17:34,780 INFO [cloud.agent.AgentShell] (main:null) (logid:)
> agent.properties found at /etc/cloudstack/agent/agent.properties
> [root@pl-kvm1 agent]#
>
Re: Agent keeps restarting
Posted by Alex Dietrich <ad...@ussignal.com.INVALID>.
Hi Fariborz,
This is an expected behavior. CloudStack Management will perform several modifications to the host that is running the agent when the host is added to a zone and pod. At this point, the agent will start to interact normally. There isn't anything for the agent to do at this point without any configured management server to interact with.
* Alex
[photo]<http://www.ussignal.com>
Alex Dietrich
Senior Network Engineer, US Signal
616-233-5094<tel:616-233-5094> | www.ussignal.com<https://www.ussignal.com> | adietrich@ussignal.com<ma...@ussignal.com>
201 Ionia Ave SW, Grand Rapids, MI 49503<https://maps.google.com/?q=201%20Ionia%20Ave%20SW,%20Grand%20Rapids,%20MI%2049503>
[linkedin]<https://www.linkedin.com/company/us-signal/>
[facebook]<https://www.facebook.com/ussignalcom/>
[youtube]<https://www.youtube.com/channel/UCaFBGFfXmHziWGTFqjGzaWw>
IMPORTANT: The contents of this email are confidential. Information is intended for the named recipient(s) only. If you have received this email by mistake, please notify the sender immediately and do not disclose the contents to anyone or make copies thereof.
[__tpx__]
________________________________
From: Fariborz Navidan <md...@gmail.com>
Sent: Friday, July 12, 2024 5:19:51 PM
To: users@cloudstack.apache.org <us...@cloudstack.apache.org>
Subject: Agent keeps restarting
EXTERNAL
Hello Guys,
I have installed CS 4.18 management and agent on an AlmaLinux 9 machine. I
have not yet added any zone or any infrastructure because cloudstack-agent
service keeps auto-restarting. Below is the latest content of agent.log
file. It doesn't contain any error. It just keeps restarting.
I need to ensure the agent is running to proceed with creating zone and
adding KVM host. Please help.
Thanks in advance.
---
[root@pl-kvm1 agent]# cat agent.log
2024-07-12 23:15:18,258 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:15:18,260 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:15:18,261 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:15:28,779 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:15:28,781 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:15:28,782 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:15:39,281 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:15:39,283 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:15:39,284 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:15:49,779 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:15:49,781 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:15:49,782 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:00,281 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:00,283 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:00,283 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:10,782 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:10,784 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:10,784 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:21,275 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:21,277 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:21,278 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:31,773 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:31,775 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:31,775 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:42,275 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:42,277 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:42,278 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:16:52,774 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:16:52,776 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:16:52,777 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:17:03,273 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:17:03,275 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:17:03,276 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:17:13,814 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:17:13,816 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:17:13,816 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:17:24,279 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:17:24,281 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:17:24,282 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
2024-07-12 23:17:34,777 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Agent started
2024-07-12 23:17:34,779 INFO [cloud.agent.AgentShell] (main:null) (logid:)
Implementation Version is 4.18.2.0
2024-07-12 23:17:34,780 INFO [cloud.agent.AgentShell] (main:null) (logid:)
agent.properties found at /etc/cloudstack/agent/agent.properties
[root@pl-kvm1 agent]#