You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by "Vash_X@gmx.de" <Va...@gmx.de> on 2022/08/03 19:43:27 UTC

VR for VPC won't start anymore

Hi everyone,

faceing currently some challanges regarding my network configuration in CS
4.16.1.

Setup:
VPC with redundant routers and some tiers as well as an private gateway.

Today i wanted to restart the whole VPC - sadly only one vrouter "survived"
.... Currently i can't depoly any networks in or outside the VPC. Also the
second router shall be delployed but keeps in the stopped state.
I really dont have a clue where to look at first...

here the  logfile from the Management-Server:

2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating the VR with id=74 in datacenter Zone {"id": "1", "name":
"xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Adding nic for Virtual Router in Control network
2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Found existing network configuration for offering [Network Offering
[3-Control-System-Control-Network]: Ntwk[202|>
2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Releasing lock for Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] --
Account {"id": 1, "name": "system", "uuid>
2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Adding nic for Virtual Router in Public network
2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Found existing network configuration for offering [Network Offering
[1-Public-System-Public-Network]: Ntwk[200|Pu>
2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Releasing lock for Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] --
Account {"id": 1, "name": "system", "uuid>
2022-08-03 20:35:48,793 INFO  [c.c.n.r.NetworkHelperImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Rolling back the transaction: Time = 0 Name =  API-Job-Executor-60; called
by -TransactionLegacy.rollback:888-PrivateIpDa>
2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=236
2022-08-03 20:35:48,851 INFO  [c.c.v.VirtualMachineManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
allocating virtual machine from
template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with hostname:r-74-VM and 12
netw>
2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating entries for VM: VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3">
2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=249
2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=236
2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=240
2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=241
2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=242
2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=243
2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=244
2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=245
2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=246
2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Service SecurityGroup is not supported in the network id=247
2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Allocating disks for VM instance {id: "74", name: "r-74-VM", uuid:
"09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
2022-08-03 20:35:49,088 INFO  [o.a.c.e.o.VolumeOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
adding disk object ROOT-74 to r-74-VM
2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Rolling back the transaction: Time = 234 Name =  API-Job-Executor-60;
called by -TransactionLegacy.rollback:888-Transacti>
2022-08-03 20:35:49,099 WARN  [o.a.c.e.o.NetworkOrchestrator]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Failed to implement network Ntwk[249|Guest|30] elements and resources as a
part of network restart due to
java.lang.NullPointerException
        at
org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSize(TemplateDataStoreVO.java:280)
        at
com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManagerImpl.java:2009)
        at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
        at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:566)
        at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
        at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
        at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
        at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
        at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocateTemplatedVolume(VolumeOrchestrator.java:834)
        at
org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocateTemplatedVolumes(VolumeOrchestrator.java:954)
        at
com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult(VirtualMachineManagerImpl.java:496)
        at
com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:25)
        at
com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:21)
        at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
        at
com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManagerImpl.java:471)
        at
com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManagerImpl.java:528)
        at
com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetworks(VpcNetworkHelperImpl.java:169)
        at
com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelperImpl.java:520)
        at
org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.deployAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
        at
org.cloud.network.router.deployment.RouterDeploymentDefinition.executeDeployment(RouterDeploymentDefinition.java:377)
        at
org.cloud.network.router.deployment.RouterDeploymentDefinition.findOrDeployVirtualRouter(RouterDeploymentDefinition.java:239)
        at
org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.findOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
        at
org.cloud.network.router.deployment.RouterDeploymentDefinition.deployVirtualRouter(RouterDeploymentDefinition.java:205)
        at
com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtualRouterElement.java:215)
        at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElements(NetworkOrchestrator.java:1488)
        at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElementsAndResources(NetworkOrchestrator.java:1423)
        at
org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restartNetwork(NetworkOrchestrator.java:3302)
        at
com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:2068)
        at
com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:2089)
        at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
        at
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.base/java.lang.reflect.Method.invoke(Method.java:566)
        at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
        at
org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
        at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
        at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
        at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
        at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
        at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
        at
org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.execute(RestartNetworkCmd.java:98)
        at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
        at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
        at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:620)
        at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48)
        at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
        at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
        at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
        at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45)
        at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:568)
        at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
        at
java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
        at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
        at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
        at java.base/java.lang.Thread.run(Thread.java:829)
2022-08-03 20:35:49,100 WARN  [c.c.n.NetworkServiceImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
Network id=249 failed to restart.
2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Complete async
job-3342, jobStatus: FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/nu>
2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Publish async
job-3342 complete on message bus
2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake up jobs
related to job-3342
2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Update db
status for job-3342
2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake up jobs
joined with job-3342 and disjoin all subjobs created from job- 3342
2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done executing
org.apache.cloudstack.api.command.user.network.RestartNetworkCmd for
job-3342

Regards,
Chris

Re: VR for VPC won't start anymore

Posted by Slavka Peleva <sl...@storpool.com.INVALID>.
Hi Christopher,

I did some tests in my lab, and maybe the more painless way to try to solve
this problem is:


   - Register a new systemvm template from here - system vm template
   <https://download.cloudstack.org/systemvm/4.16/>
   - When it is downloaded and installed, check its `template.properties`
   file to see if everything is there. Also, check the record in the DB
   - If everything looks alright - update the `type` of this template in
   the vm_template table to SYSTEM
   - Go to the configurations menu and search for `router.template.kvm`.
   Update the value with the name of the new systemvm template and restart the
   management.


With this change, CS will try to create the VR with the new template. If
that doesn't work, you could update the setting `router.template.kvm` to
its old value.

Best regards,
Slavka

On Fri, Aug 5, 2022 at 1:07 PM Vash_X@gmx.de <Va...@gmx.de> wrote:

> Hi Slavka,
>
> thank you for your explanations - really nice to have some insides of this
> whole process.
> Regarding your questions:
>
> secondary stoage vm, console proxy were created with the same template.
>
> So what has happend - i had som brief discussions with our admin team to
> get things together:
> Basically it seems that we have these problems since we tried to upgrade
> the environment to 4.17 (from the information i have, the team tried to do
> this before beeing aware of the advisory - otherwise i would have suggested
> to skip 4.17 and wait for 4.17.1 / 4.18). How ever the upgrade process
> failed for us and so we rolled back to 4.16.1. It seems that something went
> wrong in this process - as the problems occured since then. The guys
> responsible for performing the update meant, that some parts of the
> upgrade-guide where not quiet clear - especially the part on how to deploy
> the new systemvm templates since the changes made in 4.16 / 4.16.1.
>
> The environment itself "was" build up as a testbed - sadly some people
> where thinking that you can deploy services and make them useable in daily
> work - meaning its now something i would call "semi-productive".... So i
> can't just throw everything away and build it newly ...
> That's why i hope to get around the corner on "fixing" the current
> systemVM-Template / database and migrate as fast as possible to 4.17.1 -
> making the current systemtemplate "obsolete".
>
> Regards,
> Chris
>
> Am Fr., 5. Aug. 2022 um 10:16 Uhr schrieb Slavka Peleva <
> slavkap@storpool.com>:
>
>> Hi Christopher,
>>
>> Just for understanding:
>>> When deploying a new "systemvm"-template, which i normally would do
>>> while upgardeing mi CS-Environment, the values of the template.properties
>>> will be transfaired into DB. The management server will then make use of
>>> the values which are stored in the DB?
>>
>>
>> Yes. When the system VM template is seeded, CS (or you do it manually)
>> executes a script which creates the `template.properties` file and fills it
>> with the information you shared. Then it takes from it the data and updates
>> the DB. In your `template.properties` file, the `virtualsize` is empty.
>> Probably something happened while the `qemu-img info` (from that script)
>> was executed.
>>
>> I can't advise you on how to proceed because I don't know what steps you
>> made before. Is this a test setup?
>>
>> Are the system VMs (secondary storage/console proxy VMs) created with the
>> same template? Can you check when they are deployed, and are there any
>> updates on this template? You can find the info for the template in the
>> template_store_ref table -> created and last_updated columns.
>>
>> Best regards,
>> Slavka
>>
>> On Thu, Aug 4, 2022 at 9:50 PM Vash_X@gmx.de <Va...@gmx.de> wrote:
>>
>>> hi slavka,
>>> i checked the log and didn't found anything like "failed to read from
>>> template.properties".
>>>
>>> Just for understanding:
>>> When deploying a new "systemvm"-template, which i normally would do
>>> while upgardeing mi CS-Environment, the values of the template.properties
>>> will be transfaired into DB. The management server will then make use of
>>> the values which are stored in the DB?
>>>
>>> i destroyed the "stopped" router in my installation and triggered a
>>> re-deployment. The term "template" is mentioned inside the logs only for
>>> two reasons:
>>> 1. Successfull router health check of the running router (the primary
>>> one of my vpc)
>>> 2. In the mentioned error log
>>> " at
>>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSize(TemplateDataStoreVO.java:280)
>>>         at
>>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManagerImpl.java:2009)
>>> "
>>>
>>> so the question for me is  - can i manually place the missing values in
>>> the DB, so that the template is useable again? Or will i wait until i
>>> upgrade to 4.17.1 - which might bring a new systemVM template which will
>>> then be seeded again ?
>>>
>>> Regards,
>>> Chris
>>>
>>> Am Do., 4. Aug. 2022 um 19:10 Uhr schrieb Slavka Peleva <
>>> slavkap@storpool.com>:
>>>
>>>> Hi Christopher,
>>>>
>>>> For some reason, these fields' values are empty, which probably
>>>> happened while you seed the system VM template.
>>>>
>>>>> qcow2.virtualsize=
>>>>> virtualsize=
>>>>> qcow2.size=
>>>>
>>>>
>>>> From the DB record, the only option for the values of physical_size = 0
>>>> and size=Null, is that CS couldn't read the `template.properties` file. Can
>>>> you search in the management log file for a message like "Failed to read
>>>> from template.properties"? It should contain more detailed information
>>>> about the failure.
>>>>
>>>> Best regards,
>>>> Slavka
>>>>
>>>> On Thu, Aug 4, 2022 at 7:13 PM Vash_X@gmx.de <Va...@gmx.de> wrote:
>>>>
>>>>> Hi everyone -
>>>>>
>>>>> @Gary
>>>>> thanks for your input
>>>>>
>>>>> @Wei ZHOU <us...@gmail.com>
>>>>> Yes, the image is completely downloaded to the imagestore. I also
>>>>> checked
>>>>> the availeabilty on the storage beneath - everything seems to be in
>>>>> place
>>>>> like it should
>>>>>
>>>>> Following the values out ouf the db you requested:
>>>>> id= 18
>>>>> store_id = 1
>>>>> download_pct = 100
>>>>> size = "NULL"
>>>>> store_role = Image
>>>>> physical_size = 0
>>>>> download_state = DOWNLOADED
>>>>> state = READY
>>>>> install_path =
>>>>> /template/tmpl/1/212/0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>>>
>>>>> @Slavka
>>>>> Following the information of the 'template.properties'
>>>>>
>>>>> filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>>> description=SystemVM Template ( kvm )
>>>>> hvm=false
>>>>> size=460067328
>>>>> qcow2=true
>>>>> id=212
>>>>> public=true
>>>>> qcow2.filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>>> uniquename=routing-212
>>>>> qcow2.virtualsize=
>>>>> virtualsize=
>>>>> qcow2.size=
>>>>>
>>>>> Regards,
>>>>> Chris
>>>>>
>>>>> Am Do., 4. Aug. 2022 um 12:05 Uhr schrieb Slavka Peleva
>>>>> <sl...@storpool.com.invalid>:
>>>>>
>>>>> > Hi Christopher,
>>>>> >
>>>>> > Can you share the information of the `template.properties` file
>>>>> located on
>>>>> > your secondary storage, where the template file is downloaded? You
>>>>> can find
>>>>> > the path in the template_store_ref tabled - install_path.
>>>>> >
>>>>> > Best regards,
>>>>> > Slavka
>>>>> >
>>>>> > On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Gary.Dixon@quadris.co.uk
>>>>> > .invalid>
>>>>> > wrote:
>>>>> >
>>>>> > > Hi Christopher
>>>>> > >
>>>>> > > My values show :
>>>>> > > size=2621440000 physical size=375471104 and this is for a 4.15.1
>>>>> systemVM
>>>>> > > template
>>>>> > >
>>>>> > > BR
>>>>> > > Gary
>>>>> > >
>>>>> > > Gary Dixon​
>>>>> > > Senior Technical Consultant
>>>>> > > T:  *0161 537 4980* <0161%20537%204980>
>>>>> > > W: www.quadris.co.uk
>>>>> > > The information contained in this e-mail from Quadris may be
>>>>> confidential
>>>>> > > and privileged for the private use of the named recipient.  The
>>>>> contents
>>>>> > of
>>>>> > > this e-mail may not necessarily represent the official views of
>>>>> Quadris.
>>>>> > > If you have received this information in error you must not copy,
>>>>> > > distribute or take any action or reliance on its contents.  Please
>>>>> > destroy
>>>>> > > any hard copies and delete this message.
>>>>> > > -----Original Message-----
>>>>> > > From: Vash_X@gmx.de <Va...@gmx.de>
>>>>> > > Sent: 04 August 2022 09:40
>>>>> > > To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
>>>>> > > Subject: Re: VR for VPC won't start anymore
>>>>> > >
>>>>> > > I forgot to ask - might anyone take a quick look into the database
>>>>> and
>>>>> > can
>>>>> > > give a hind if the fields are indeed "filled" with values
>>>>> > > (template_store_res.size / template_store_res.physical_size)?
>>>>> > > Another question for understanding would be the difference of the
>>>>> values
>>>>> > -
>>>>> > > physical size is the actual amount of data on a datasystemlevel -
>>>>> but
>>>>> > what
>>>>> > > represents the value of "size"?
>>>>> > >
>>>>> > > Regards,
>>>>> > > Christopher
>>>>> > >
>>>>> > > Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <
>>>>> Vash_X@gmx.de>:
>>>>> > >
>>>>> > > > Wei, seems like you are heading twards the right direction - like
>>>>> > always.
>>>>> > > >
>>>>> > > > i took a look into the "template_store_res" table... and guess:
>>>>> There
>>>>> > > > is a entry for the current systemvmtemplate-4.16.1. How ever: The
>>>>> > > > field for "size" ist "null" and "physical_size" is "0".
>>>>> > > >
>>>>> > > > Might this be the reason for the "
>>>>> java.lang.NullPointerException" ?
>>>>> > > >
>>>>> > > > Regards,
>>>>> > > > Chris
>>>>> > > >
>>>>> > > > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
>>>>> > > > <ustcweizhou@gmail.com
>>>>> > > > >:
>>>>> > > >
>>>>> > > >> It looks there is no entry in template_store_ref table for the
>>>>> > > >> systemvm template
>>>>> > > >>
>>>>> > > >> -Wei
>>>>> > > >>
>>>>> > > >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de>
>>>>> wrote:
>>>>> > > >>
>>>>> > > >> > Hi everyone,
>>>>> > > >> >
>>>>> > > >> > faceing currently some challanges regarding my network
>>>>> > > >> > configuration in
>>>>> > > >> CS
>>>>> > > >> > 4.16.1.
>>>>> > > >> >
>>>>> > > >> > Setup:
>>>>> > > >> > VPC with redundant routers and some tiers as well as an
>>>>> private
>>>>> > > gateway.
>>>>> > > >> >
>>>>> > > >> > Today i wanted to restart the whole VPC - sadly only one
>>>>> vrouter
>>>>> > > >> > "survived" .... Currently i can't depoly any networks in or
>>>>> outside
>>>>> > > >> > the VPC. Also the second router shall be delployed but keeps
>>>>> in the
>>>>> > > >> > stopped state.
>>>>> > > >> > I really dont have a clue where to look at first...
>>>>> > > >> >
>>>>> > > >> > here the logfile from the Management-Server:
>>>>> > > >> >
>>>>> > > >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating the VR with id=74 in datacenter Zone {"id": "1",
>>>>> "name":
>>>>> > > >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
>>>>> > > >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Adding nic for Virtual Router in Control network
>>>>> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Found existing network configuration for offering [Network
>>>>> Offering
>>>>> > > >> > [3-Control-System-Control-Network]: Ntwk[202|>
>>>>> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Releasing lock for
>>>>> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>>>> {"id":
>>>>> > > >> > 1, "name": "system", "uuid>
>>>>> > > >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Adding nic for Virtual Router in Public network
>>>>> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Found existing network configuration for offering [Network
>>>>> Offering
>>>>> > > >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
>>>>> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Releasing lock for
>>>>> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>>>> {"id":
>>>>> > > >> > 1, "name": "system", "uuid>
>>>>> > > >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
>>>>> > > >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Adding nic for Virtual Router in Guest network
>>>>> Ntwk[249|Guest|30]
>>>>> > > >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Rolling back the transaction: Time = 0 Name =
>>>>> API-Job-Executor-60;
>>>>> > > >> called
>>>>> > > >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
>>>>> > > >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=236
>>>>> > > >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > allocating virtual machine from
>>>>> > > >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with
>>>>> hostname:r-74-VM
>>>>> > > >> > and
>>>>> > > >> 12
>>>>> > > >> > netw>
>>>>> > > >> > 2022-08-03 20:35:48,852 DEBUG
>>>>> [c.c.v.VirtualMachineManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating entries for VM: VM instance {id: "74", name:
>>>>> "r-74-VM",
>>>>> > > uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
>>>>> > > >> > 2022-08-03 20:35:48,857 DEBUG
>>>>> [c.c.v.VirtualMachineManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nics for VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=249
>>>>> > > >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=236
>>>>> > > >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=240
>>>>> > > >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=241
>>>>> > > >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=242
>>>>> > > >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=243
>>>>> > > >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=244
>>>>> > > >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=245
>>>>> > > >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=246
>>>>> > > >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > > >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Service SecurityGroup is not supported in the network id=247
>>>>> > > >> > 2022-08-03 20:35:49,088 DEBUG
>>>>> [c.c.v.VirtualMachineManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Allocating disks for VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
>>>>> > > >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > adding disk object ROOT-74 to r-74-VM
>>>>> > > >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Rolling back the transaction: Time = 234 Name =
>>>>> > > >> > API-Job-Executor-60; called by
>>>>> > > >> > -TransactionLegacy.rollback:888-Transacti>
>>>>> > > >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Failed to implement network Ntwk[249|Guest|30] elements and
>>>>> > > >> > resources
>>>>> > > >> as a
>>>>> > > >> > part of network restart due to
>>>>> > > >> > java.lang.NullPointerException
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
>>>>> > > >> e(TemplateDataStoreVO.java:280)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
>>>>> > > >> rImpl.java:2009)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>>>> > > >> > ive
>>>>> > > >> > Method)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>>>> > > >> MethodAccessorImpl.java:62)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>>>> > > >> legatingMethodAccessorImpl.java:43)
>>>>> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>>>> > > >> on(AopUtils.java:344)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>>>> > > >> inpoint(ReflectiveMethodInvocation.java:198)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > > >> ReflectiveMethodInvocation.java:163)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>>>> > > >> e(ExposeInvocationInterceptor.java:97)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > > >> ReflectiveMethodInvocation.java:186)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>>>> > > >> cAopProxy.java:215)
>>>>> > > >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>>>> > > >> eTemplatedVolume(VolumeOrchestrator.java:834)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>>>> > > >> eTemplatedVolumes(VolumeOrchestrator.java:954)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
>>>>> > > >> (VirtualMachineManagerImpl.java:496)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>>>> > > >> action(TransactionCallbackWithExceptionNoReturn.java:25)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>>>> > > >> action(TransactionCallbackWithExceptionNoReturn.java:21)
>>>>> > > >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>>>> > > >> Impl.java:471)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>>>> > > >> Impl.java:528)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
>>>>> > > >> s(VpcNetworkHelperImpl.java:169)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
>>>>> > > >> Impl.java:520)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
>>>>> > > >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
>>>>> > > >> eDeployment(RouterDeploymentDefinition.java:377)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
>>>>> > > >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
>>>>> > > >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
>>>>> > > >> VirtualRouter(RouterDeploymentDefinition.java:205)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
>>>>> > > >> lRouterElement.java:215)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>>>> > > >> entNetworkElements(NetworkOrchestrator.java:1488)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>>>> > > >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
>>>>> > > >> tNetwork(NetworkOrchestrator.java:3302)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>>>> > > >> l.java:2068)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>>>> > > >> l.java:2089)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>>>> > > >> > ive
>>>>> > > >> > Method)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>>>> > > >> MethodAccessorImpl.java:62)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>>>> > > >> legatingMethodAccessorImpl.java:43)
>>>>> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>>>> > > >> on(AopUtils.java:344)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>>>> > > >> inpoint(ReflectiveMethodInvocation.java:198)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > > >> ReflectiveMethodInvocation.java:163)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
>>>>> > > >> erceptor.invoke(EventUtils.java:107)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > > >> ReflectiveMethodInvocation.java:175)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
>>>>> > > >> java:51)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > > >> ReflectiveMethodInvocation.java:175)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>>>> > > >> e(ExposeInvocationInterceptor.java:97)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > > >> ReflectiveMethodInvocation.java:186)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>>>> > > >> cAopProxy.java:215)
>>>>> > > >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
>>>>> > > >> ute(RestartNetworkCmd.java:98)
>>>>> > > >> > at
>>>>> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
>>>>> > > >> :108)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
>>>>> > > >> Context(AsyncJobManagerImpl.java:620)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
>>>>> > > >> nagedContextRunnable.java:48)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca
>>>>> > > >> ll(DefaultManagedContext.java:55)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
>>>>> > > >> WithContext(DefaultManagedContext.java:102)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
>>>>> > > >> ithContext(DefaultManagedContext.java:52)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
>>>>> > > >> gedContextRunnable.java:45)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
>>>>> > > >> syncJobManagerImpl.java:568)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
>>>>> > > >> rs.java:515)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
>>>>> > > >> lExecutor.java:1128)
>>>>> > > >> > at
>>>>> > > >> >
>>>>> > > >>
>>>>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
>>>>> > > >> olExecutor.java:628)
>>>>> > > >> > at java.base/java.lang.Thread.run(Thread.java:829)
>>>>> > > >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > > >> (logid:6b6b9867)
>>>>> > > >> > Network id=249 failed to restart.
>>>>> > > >> > 2022-08-03 20:35:49,111 DEBUG
>>>>> [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> > > >> > Complete
>>>>> > > >> async
>>>>> > > >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
>>>>> > > >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
>>>>> > > >> > 2022-08-03 20:35:49,112 DEBUG
>>>>> [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> > > >> > Publish
>>>>> > > >> async
>>>>> > > >> > job-3342 complete on message bus
>>>>> > > >> > 2022-08-03 20:35:49,112 DEBUG
>>>>> [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> Wake
>>>>> > > >> > up
>>>>> > > >> jobs
>>>>> > > >> > related to job-3342
>>>>> > > >> > 2022-08-03 20:35:49,112 DEBUG
>>>>> [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> Update
>>>>> > > >> > db status for job-3342
>>>>> > > >> > 2022-08-03 20:35:49,114 DEBUG
>>>>> [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> Wake
>>>>> > > >> > up
>>>>> > > >> jobs
>>>>> > > >> > joined with job-3342 and disjoin all subjobs created from
>>>>> job- 3342
>>>>> > > >> > 2022-08-03 20:35:49,119 DEBUG
>>>>> [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> Done
>>>>> > > >> executing
>>>>> > > >> >
>>>>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
>>>>> > > >> > for
>>>>> > > >> > job-3342
>>>>> > > >> >
>>>>> > > >> > Regards,
>>>>> > > >> > Chris
>>>>> > > >> >
>>>>> > > >>
>>>>> > > >
>>>>> > >
>>>>> >
>>>>>
>>>>

Re: VR for VPC won't start anymore

Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
Hi Slavka,

thank you for your explanations - really nice to have some insides of this
whole process.
Regarding your questions:

secondary stoage vm, console proxy were created with the same template.

So what has happend - i had som brief discussions with our admin team to
get things together:
Basically it seems that we have these problems since we tried to upgrade
the environment to 4.17 (from the information i have, the team tried to do
this before beeing aware of the advisory - otherwise i would have suggested
to skip 4.17 and wait for 4.17.1 / 4.18). How ever the upgrade process
failed for us and so we rolled back to 4.16.1. It seems that something went
wrong in this process - as the problems occured since then. The guys
responsible for performing the update meant, that some parts of the
upgrade-guide where not quiet clear - especially the part on how to deploy
the new systemvm templates since the changes made in 4.16 / 4.16.1.

The environment itself "was" build up as a testbed - sadly some people
where thinking that you can deploy services and make them useable in daily
work - meaning its now something i would call "semi-productive".... So i
can't just throw everything away and build it newly ...
That's why i hope to get around the corner on "fixing" the current
systemVM-Template / database and migrate as fast as possible to 4.17.1 -
making the current systemtemplate "obsolete".

Regards,
Chris

Am Fr., 5. Aug. 2022 um 10:16 Uhr schrieb Slavka Peleva <
slavkap@storpool.com>:

> Hi Christopher,
>
> Just for understanding:
>> When deploying a new "systemvm"-template, which i normally would do while
>> upgardeing mi CS-Environment, the values of the template.properties will be
>> transfaired into DB. The management server will then make use of the values
>> which are stored in the DB?
>
>
> Yes. When the system VM template is seeded, CS (or you do it manually)
> executes a script which creates the `template.properties` file and fills it
> with the information you shared. Then it takes from it the data and updates
> the DB. In your `template.properties` file, the `virtualsize` is empty.
> Probably something happened while the `qemu-img info` (from that script)
> was executed.
>
> I can't advise you on how to proceed because I don't know what steps you
> made before. Is this a test setup?
>
> Are the system VMs (secondary storage/console proxy VMs) created with the
> same template? Can you check when they are deployed, and are there any
> updates on this template? You can find the info for the template in the
> template_store_ref table -> created and last_updated columns.
>
> Best regards,
> Slavka
>
> On Thu, Aug 4, 2022 at 9:50 PM Vash_X@gmx.de <Va...@gmx.de> wrote:
>
>> hi slavka,
>> i checked the log and didn't found anything like "failed to read from
>> template.properties".
>>
>> Just for understanding:
>> When deploying a new "systemvm"-template, which i normally would do while
>> upgardeing mi CS-Environment, the values of the template.properties will be
>> transfaired into DB. The management server will then make use of the values
>> which are stored in the DB?
>>
>> i destroyed the "stopped" router in my installation and triggered a
>> re-deployment. The term "template" is mentioned inside the logs only for
>> two reasons:
>> 1. Successfull router health check of the running router (the primary one
>> of my vpc)
>> 2. In the mentioned error log
>> " at
>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSize(TemplateDataStoreVO.java:280)
>>         at
>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManagerImpl.java:2009)
>> "
>>
>> so the question for me is  - can i manually place the missing values in
>> the DB, so that the template is useable again? Or will i wait until i
>> upgrade to 4.17.1 - which might bring a new systemVM template which will
>> then be seeded again ?
>>
>> Regards,
>> Chris
>>
>> Am Do., 4. Aug. 2022 um 19:10 Uhr schrieb Slavka Peleva <
>> slavkap@storpool.com>:
>>
>>> Hi Christopher,
>>>
>>> For some reason, these fields' values are empty, which probably
>>> happened while you seed the system VM template.
>>>
>>>> qcow2.virtualsize=
>>>> virtualsize=
>>>> qcow2.size=
>>>
>>>
>>> From the DB record, the only option for the values of physical_size = 0
>>> and size=Null, is that CS couldn't read the `template.properties` file. Can
>>> you search in the management log file for a message like "Failed to read
>>> from template.properties"? It should contain more detailed information
>>> about the failure.
>>>
>>> Best regards,
>>> Slavka
>>>
>>> On Thu, Aug 4, 2022 at 7:13 PM Vash_X@gmx.de <Va...@gmx.de> wrote:
>>>
>>>> Hi everyone -
>>>>
>>>> @Gary
>>>> thanks for your input
>>>>
>>>> @Wei ZHOU <us...@gmail.com>
>>>> Yes, the image is completely downloaded to the imagestore. I also
>>>> checked
>>>> the availeabilty on the storage beneath - everything seems to be in
>>>> place
>>>> like it should
>>>>
>>>> Following the values out ouf the db you requested:
>>>> id= 18
>>>> store_id = 1
>>>> download_pct = 100
>>>> size = "NULL"
>>>> store_role = Image
>>>> physical_size = 0
>>>> download_state = DOWNLOADED
>>>> state = READY
>>>> install_path =
>>>> /template/tmpl/1/212/0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>>
>>>> @Slavka
>>>> Following the information of the 'template.properties'
>>>>
>>>> filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>> description=SystemVM Template ( kvm )
>>>> hvm=false
>>>> size=460067328
>>>> qcow2=true
>>>> id=212
>>>> public=true
>>>> qcow2.filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>> uniquename=routing-212
>>>> qcow2.virtualsize=
>>>> virtualsize=
>>>> qcow2.size=
>>>>
>>>> Regards,
>>>> Chris
>>>>
>>>> Am Do., 4. Aug. 2022 um 12:05 Uhr schrieb Slavka Peleva
>>>> <sl...@storpool.com.invalid>:
>>>>
>>>> > Hi Christopher,
>>>> >
>>>> > Can you share the information of the `template.properties` file
>>>> located on
>>>> > your secondary storage, where the template file is downloaded? You
>>>> can find
>>>> > the path in the template_store_ref tabled - install_path.
>>>> >
>>>> > Best regards,
>>>> > Slavka
>>>> >
>>>> > On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Gary.Dixon@quadris.co.uk
>>>> > .invalid>
>>>> > wrote:
>>>> >
>>>> > > Hi Christopher
>>>> > >
>>>> > > My values show :
>>>> > > size=2621440000 physical size=375471104 and this is for a 4.15.1
>>>> systemVM
>>>> > > template
>>>> > >
>>>> > > BR
>>>> > > Gary
>>>> > >
>>>> > > Gary Dixon​
>>>> > > Senior Technical Consultant
>>>> > > T:  *0161 537 4980* <0161%20537%204980>
>>>> > > W: www.quadris.co.uk
>>>> > > The information contained in this e-mail from Quadris may be
>>>> confidential
>>>> > > and privileged for the private use of the named recipient.  The
>>>> contents
>>>> > of
>>>> > > this e-mail may not necessarily represent the official views of
>>>> Quadris.
>>>> > > If you have received this information in error you must not copy,
>>>> > > distribute or take any action or reliance on its contents.  Please
>>>> > destroy
>>>> > > any hard copies and delete this message.
>>>> > > -----Original Message-----
>>>> > > From: Vash_X@gmx.de <Va...@gmx.de>
>>>> > > Sent: 04 August 2022 09:40
>>>> > > To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
>>>> > > Subject: Re: VR for VPC won't start anymore
>>>> > >
>>>> > > I forgot to ask - might anyone take a quick look into the database
>>>> and
>>>> > can
>>>> > > give a hind if the fields are indeed "filled" with values
>>>> > > (template_store_res.size / template_store_res.physical_size)?
>>>> > > Another question for understanding would be the difference of the
>>>> values
>>>> > -
>>>> > > physical size is the actual amount of data on a datasystemlevel -
>>>> but
>>>> > what
>>>> > > represents the value of "size"?
>>>> > >
>>>> > > Regards,
>>>> > > Christopher
>>>> > >
>>>> > > Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <
>>>> Vash_X@gmx.de>:
>>>> > >
>>>> > > > Wei, seems like you are heading twards the right direction - like
>>>> > always.
>>>> > > >
>>>> > > > i took a look into the "template_store_res" table... and guess:
>>>> There
>>>> > > > is a entry for the current systemvmtemplate-4.16.1. How ever: The
>>>> > > > field for "size" ist "null" and "physical_size" is "0".
>>>> > > >
>>>> > > > Might this be the reason for the "
>>>> java.lang.NullPointerException" ?
>>>> > > >
>>>> > > > Regards,
>>>> > > > Chris
>>>> > > >
>>>> > > > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
>>>> > > > <ustcweizhou@gmail.com
>>>> > > > >:
>>>> > > >
>>>> > > >> It looks there is no entry in template_store_ref table for the
>>>> > > >> systemvm template
>>>> > > >>
>>>> > > >> -Wei
>>>> > > >>
>>>> > > >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de>
>>>> wrote:
>>>> > > >>
>>>> > > >> > Hi everyone,
>>>> > > >> >
>>>> > > >> > faceing currently some challanges regarding my network
>>>> > > >> > configuration in
>>>> > > >> CS
>>>> > > >> > 4.16.1.
>>>> > > >> >
>>>> > > >> > Setup:
>>>> > > >> > VPC with redundant routers and some tiers as well as an private
>>>> > > gateway.
>>>> > > >> >
>>>> > > >> > Today i wanted to restart the whole VPC - sadly only one
>>>> vrouter
>>>> > > >> > "survived" .... Currently i can't depoly any networks in or
>>>> outside
>>>> > > >> > the VPC. Also the second router shall be delployed but keeps
>>>> in the
>>>> > > >> > stopped state.
>>>> > > >> > I really dont have a clue where to look at first...
>>>> > > >> >
>>>> > > >> > here the logfile from the Management-Server:
>>>> > > >> >
>>>> > > >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating the VR with id=74 in datacenter Zone {"id": "1",
>>>> "name":
>>>> > > >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
>>>> > > >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Adding nic for Virtual Router in Control network
>>>> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Found existing network configuration for offering [Network
>>>> Offering
>>>> > > >> > [3-Control-System-Control-Network]: Ntwk[202|>
>>>> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Releasing lock for
>>>> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>>> {"id":
>>>> > > >> > 1, "name": "system", "uuid>
>>>> > > >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Adding nic for Virtual Router in Public network
>>>> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Found existing network configuration for offering [Network
>>>> Offering
>>>> > > >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
>>>> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Releasing lock for
>>>> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>>> {"id":
>>>> > > >> > 1, "name": "system", "uuid>
>>>> > > >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
>>>> > > >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Adding nic for Virtual Router in Guest network
>>>> Ntwk[249|Guest|30]
>>>> > > >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Rolling back the transaction: Time = 0 Name =
>>>> API-Job-Executor-60;
>>>> > > >> called
>>>> > > >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
>>>> > > >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=236
>>>> > > >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > allocating virtual machine from
>>>> > > >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with
>>>> hostname:r-74-VM
>>>> > > >> > and
>>>> > > >> 12
>>>> > > >> > netw>
>>>> > > >> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating entries for VM: VM instance {id: "74", name:
>>>> "r-74-VM",
>>>> > > uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
>>>> > > >> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nics for VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=249
>>>> > > >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=236
>>>> > > >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=240
>>>> > > >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=241
>>>> > > >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=242
>>>> > > >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=243
>>>> > > >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=244
>>>> > > >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=245
>>>> > > >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=246
>>>> > > >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > > >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Service SecurityGroup is not supported in the network id=247
>>>> > > >> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Allocating disks for VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
>>>> > > >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > adding disk object ROOT-74 to r-74-VM
>>>> > > >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Rolling back the transaction: Time = 234 Name =
>>>> > > >> > API-Job-Executor-60; called by
>>>> > > >> > -TransactionLegacy.rollback:888-Transacti>
>>>> > > >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Failed to implement network Ntwk[249|Guest|30] elements and
>>>> > > >> > resources
>>>> > > >> as a
>>>> > > >> > part of network restart due to
>>>> > > >> > java.lang.NullPointerException
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
>>>> > > >> e(TemplateDataStoreVO.java:280)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
>>>> > > >> rImpl.java:2009)
>>>> > > >> > at
>>>> > > >> >
>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>>> > > >> > ive
>>>> > > >> > Method)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>>> > > >> MethodAccessorImpl.java:62)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>>> > > >> legatingMethodAccessorImpl.java:43)
>>>> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>>> > > >> on(AopUtils.java:344)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>>> > > >> inpoint(ReflectiveMethodInvocation.java:198)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > > >> ReflectiveMethodInvocation.java:163)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>>> > > >> e(ExposeInvocationInterceptor.java:97)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > > >> ReflectiveMethodInvocation.java:186)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>>> > > >> cAopProxy.java:215)
>>>> > > >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>>> > > >> eTemplatedVolume(VolumeOrchestrator.java:834)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>>> > > >> eTemplatedVolumes(VolumeOrchestrator.java:954)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
>>>> > > >> (VirtualMachineManagerImpl.java:496)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>>> > > >> action(TransactionCallbackWithExceptionNoReturn.java:25)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>>> > > >> action(TransactionCallbackWithExceptionNoReturn.java:21)
>>>> > > >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>>> > > >> Impl.java:471)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>>> > > >> Impl.java:528)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
>>>> > > >> s(VpcNetworkHelperImpl.java:169)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
>>>> > > >> Impl.java:520)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
>>>> > > >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
>>>> > > >> eDeployment(RouterDeploymentDefinition.java:377)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
>>>> > > >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
>>>> > > >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
>>>> > > >> VirtualRouter(RouterDeploymentDefinition.java:205)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
>>>> > > >> lRouterElement.java:215)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>>> > > >> entNetworkElements(NetworkOrchestrator.java:1488)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>>> > > >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
>>>> > > >> tNetwork(NetworkOrchestrator.java:3302)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>>> > > >> l.java:2068)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>>> > > >> l.java:2089)
>>>> > > >> > at
>>>> > > >> >
>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>>> > > >> > ive
>>>> > > >> > Method)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>>> > > >> MethodAccessorImpl.java:62)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>>> > > >> legatingMethodAccessorImpl.java:43)
>>>> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>>> > > >> on(AopUtils.java:344)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>>> > > >> inpoint(ReflectiveMethodInvocation.java:198)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > > >> ReflectiveMethodInvocation.java:163)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
>>>> > > >> erceptor.invoke(EventUtils.java:107)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > > >> ReflectiveMethodInvocation.java:175)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
>>>> > > >> java:51)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > > >> ReflectiveMethodInvocation.java:175)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>>> > > >> e(ExposeInvocationInterceptor.java:97)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > > >> ReflectiveMethodInvocation.java:186)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>>> > > >> cAopProxy.java:215)
>>>> > > >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
>>>> > > >> ute(RestartNetworkCmd.java:98)
>>>> > > >> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
>>>> > > >> :108)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
>>>> > > >> Context(AsyncJobManagerImpl.java:620)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
>>>> > > >> nagedContextRunnable.java:48)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$
>>>> 1.ca
>>>> > > >> ll(DefaultManagedContext.java:55)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
>>>> > > >> WithContext(DefaultManagedContext.java:102)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
>>>> > > >> ithContext(DefaultManagedContext.java:52)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
>>>> > > >> gedContextRunnable.java:45)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
>>>> > > >> syncJobManagerImpl.java:568)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
>>>> > > >> rs.java:515)
>>>> > > >> > at
>>>> > > >> >
>>>> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
>>>> > > >> lExecutor.java:1128)
>>>> > > >> > at
>>>> > > >> >
>>>> > > >>
>>>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
>>>> > > >> olExecutor.java:628)
>>>> > > >> > at java.base/java.lang.Thread.run(Thread.java:829)
>>>> > > >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > > >> (logid:6b6b9867)
>>>> > > >> > Network id=249 failed to restart.
>>>> > > >> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>> > > >> > Complete
>>>> > > >> async
>>>> > > >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
>>>> > > >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
>>>> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>> > > >> > Publish
>>>> > > >> async
>>>> > > >> > job-3342 complete on message bus
>>>> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>> Wake
>>>> > > >> > up
>>>> > > >> jobs
>>>> > > >> > related to job-3342
>>>> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>> Update
>>>> > > >> > db status for job-3342
>>>> > > >> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>> Wake
>>>> > > >> > up
>>>> > > >> jobs
>>>> > > >> > joined with job-3342 and disjoin all subjobs created from job-
>>>> 3342
>>>> > > >> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>> Done
>>>> > > >> executing
>>>> > > >> >
>>>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
>>>> > > >> > for
>>>> > > >> > job-3342
>>>> > > >> >
>>>> > > >> > Regards,
>>>> > > >> > Chris
>>>> > > >> >
>>>> > > >>
>>>> > > >
>>>> > >
>>>> >
>>>>
>>>

Re: VR for VPC won't start anymore

Posted by Slavka Peleva <sl...@storpool.com.INVALID>.
Hi Christopher,

Just for understanding:
> When deploying a new "systemvm"-template, which i normally would do while
> upgardeing mi CS-Environment, the values of the template.properties will be
> transfaired into DB. The management server will then make use of the values
> which are stored in the DB?


Yes. When the system VM template is seeded, CS (or you do it manually)
executes a script which creates the `template.properties` file and fills it
with the information you shared. Then it takes from it the data and updates
the DB. In your `template.properties` file, the `virtualsize` is empty.
Probably something happened while the `qemu-img info` (from that script)
was executed.

I can't advise you on how to proceed because I don't know what steps you
made before. Is this a test setup?

Are the system VMs (secondary storage/console proxy VMs) created with the
same template? Can you check when they are deployed, and are there any
updates on this template? You can find the info for the template in the
template_store_ref table -> created and last_updated columns.

Best regards,
Slavka

On Thu, Aug 4, 2022 at 9:50 PM Vash_X@gmx.de <Va...@gmx.de> wrote:

> hi slavka,
> i checked the log and didn't found anything like "failed to read from
> template.properties".
>
> Just for understanding:
> When deploying a new "systemvm"-template, which i normally would do while
> upgardeing mi CS-Environment, the values of the template.properties will be
> transfaired into DB. The management server will then make use of the values
> which are stored in the DB?
>
> i destroyed the "stopped" router in my installation and triggered a
> re-deployment. The term "template" is mentioned inside the logs only for
> two reasons:
> 1. Successfull router health check of the running router (the primary one
> of my vpc)
> 2. In the mentioned error log
> " at
> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSize(TemplateDataStoreVO.java:280)
>         at
> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManagerImpl.java:2009)
> "
>
> so the question for me is  - can i manually place the missing values in
> the DB, so that the template is useable again? Or will i wait until i
> upgrade to 4.17.1 - which might bring a new systemVM template which will
> then be seeded again ?
>
> Regards,
> Chris
>
> Am Do., 4. Aug. 2022 um 19:10 Uhr schrieb Slavka Peleva <
> slavkap@storpool.com>:
>
>> Hi Christopher,
>>
>> For some reason, these fields' values are empty, which probably
>> happened while you seed the system VM template.
>>
>>> qcow2.virtualsize=
>>> virtualsize=
>>> qcow2.size=
>>
>>
>> From the DB record, the only option for the values of physical_size = 0
>> and size=Null, is that CS couldn't read the `template.properties` file. Can
>> you search in the management log file for a message like "Failed to read
>> from template.properties"? It should contain more detailed information
>> about the failure.
>>
>> Best regards,
>> Slavka
>>
>> On Thu, Aug 4, 2022 at 7:13 PM Vash_X@gmx.de <Va...@gmx.de> wrote:
>>
>>> Hi everyone -
>>>
>>> @Gary
>>> thanks for your input
>>>
>>> @Wei ZHOU <us...@gmail.com>
>>> Yes, the image is completely downloaded to the imagestore. I also checked
>>> the availeabilty on the storage beneath - everything seems to be in place
>>> like it should
>>>
>>> Following the values out ouf the db you requested:
>>> id= 18
>>> store_id = 1
>>> download_pct = 100
>>> size = "NULL"
>>> store_role = Image
>>> physical_size = 0
>>> download_state = DOWNLOADED
>>> state = READY
>>> install_path =
>>> /template/tmpl/1/212/0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>
>>> @Slavka
>>> Following the information of the 'template.properties'
>>>
>>> filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>> description=SystemVM Template ( kvm )
>>> hvm=false
>>> size=460067328
>>> qcow2=true
>>> id=212
>>> public=true
>>> qcow2.filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>> uniquename=routing-212
>>> qcow2.virtualsize=
>>> virtualsize=
>>> qcow2.size=
>>>
>>> Regards,
>>> Chris
>>>
>>> Am Do., 4. Aug. 2022 um 12:05 Uhr schrieb Slavka Peleva
>>> <sl...@storpool.com.invalid>:
>>>
>>> > Hi Christopher,
>>> >
>>> > Can you share the information of the `template.properties` file
>>> located on
>>> > your secondary storage, where the template file is downloaded? You can
>>> find
>>> > the path in the template_store_ref tabled - install_path.
>>> >
>>> > Best regards,
>>> > Slavka
>>> >
>>> > On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Gary.Dixon@quadris.co.uk
>>> > .invalid>
>>> > wrote:
>>> >
>>> > > Hi Christopher
>>> > >
>>> > > My values show :
>>> > > size=2621440000 physical size=375471104 and this is for a 4.15.1
>>> systemVM
>>> > > template
>>> > >
>>> > > BR
>>> > > Gary
>>> > >
>>> > > Gary Dixon​
>>> > > Senior Technical Consultant
>>> > > T:  *0161 537 4980* <0161%20537%204980>
>>> > > W: www.quadris.co.uk
>>> > > The information contained in this e-mail from Quadris may be
>>> confidential
>>> > > and privileged for the private use of the named recipient.  The
>>> contents
>>> > of
>>> > > this e-mail may not necessarily represent the official views of
>>> Quadris.
>>> > > If you have received this information in error you must not copy,
>>> > > distribute or take any action or reliance on its contents.  Please
>>> > destroy
>>> > > any hard copies and delete this message.
>>> > > -----Original Message-----
>>> > > From: Vash_X@gmx.de <Va...@gmx.de>
>>> > > Sent: 04 August 2022 09:40
>>> > > To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
>>> > > Subject: Re: VR for VPC won't start anymore
>>> > >
>>> > > I forgot to ask - might anyone take a quick look into the database
>>> and
>>> > can
>>> > > give a hind if the fields are indeed "filled" with values
>>> > > (template_store_res.size / template_store_res.physical_size)?
>>> > > Another question for understanding would be the difference of the
>>> values
>>> > -
>>> > > physical size is the actual amount of data on a datasystemlevel - but
>>> > what
>>> > > represents the value of "size"?
>>> > >
>>> > > Regards,
>>> > > Christopher
>>> > >
>>> > > Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <
>>> Vash_X@gmx.de>:
>>> > >
>>> > > > Wei, seems like you are heading twards the right direction - like
>>> > always.
>>> > > >
>>> > > > i took a look into the "template_store_res" table... and guess:
>>> There
>>> > > > is a entry for the current systemvmtemplate-4.16.1. How ever: The
>>> > > > field for "size" ist "null" and "physical_size" is "0".
>>> > > >
>>> > > > Might this be the reason for the " java.lang.NullPointerException"
>>> ?
>>> > > >
>>> > > > Regards,
>>> > > > Chris
>>> > > >
>>> > > > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
>>> > > > <ustcweizhou@gmail.com
>>> > > > >:
>>> > > >
>>> > > >> It looks there is no entry in template_store_ref table for the
>>> > > >> systemvm template
>>> > > >>
>>> > > >> -Wei
>>> > > >>
>>> > > >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>> > > >>
>>> > > >> > Hi everyone,
>>> > > >> >
>>> > > >> > faceing currently some challanges regarding my network
>>> > > >> > configuration in
>>> > > >> CS
>>> > > >> > 4.16.1.
>>> > > >> >
>>> > > >> > Setup:
>>> > > >> > VPC with redundant routers and some tiers as well as an private
>>> > > gateway.
>>> > > >> >
>>> > > >> > Today i wanted to restart the whole VPC - sadly only one vrouter
>>> > > >> > "survived" .... Currently i can't depoly any networks in or
>>> outside
>>> > > >> > the VPC. Also the second router shall be delployed but keeps in
>>> the
>>> > > >> > stopped state.
>>> > > >> > I really dont have a clue where to look at first...
>>> > > >> >
>>> > > >> > here the logfile from the Management-Server:
>>> > > >> >
>>> > > >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating the VR with id=74 in datacenter Zone {"id": "1",
>>> "name":
>>> > > >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
>>> > > >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Adding nic for Virtual Router in Control network
>>> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Found existing network configuration for offering [Network
>>> Offering
>>> > > >> > [3-Control-System-Control-Network]: Ntwk[202|>
>>> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Releasing lock for
>>> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>> {"id":
>>> > > >> > 1, "name": "system", "uuid>
>>> > > >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Adding nic for Virtual Router in Public network
>>> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Found existing network configuration for offering [Network
>>> Offering
>>> > > >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
>>> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Releasing lock for
>>> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>> {"id":
>>> > > >> > 1, "name": "system", "uuid>
>>> > > >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
>>> > > >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Adding nic for Virtual Router in Guest network
>>> Ntwk[249|Guest|30]
>>> > > >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Rolling back the transaction: Time = 0 Name =
>>> API-Job-Executor-60;
>>> > > >> called
>>> > > >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
>>> > > >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=236
>>> > > >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > allocating virtual machine from
>>> > > >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with
>>> hostname:r-74-VM
>>> > > >> > and
>>> > > >> 12
>>> > > >> > netw>
>>> > > >> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating entries for VM: VM instance {id: "74", name:
>>> "r-74-VM",
>>> > > uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
>>> > > >> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nics for VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=249
>>> > > >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=236
>>> > > >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=240
>>> > > >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=241
>>> > > >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=242
>>> > > >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=243
>>> > > >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=244
>>> > > >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=245
>>> > > >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=246
>>> > > >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > > >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Service SecurityGroup is not supported in the network id=247
>>> > > >> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Allocating disks for VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
>>> > > >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > adding disk object ROOT-74 to r-74-VM
>>> > > >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Rolling back the transaction: Time = 234 Name =
>>> > > >> > API-Job-Executor-60; called by
>>> > > >> > -TransactionLegacy.rollback:888-Transacti>
>>> > > >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Failed to implement network Ntwk[249|Guest|30] elements and
>>> > > >> > resources
>>> > > >> as a
>>> > > >> > part of network restart due to
>>> > > >> > java.lang.NullPointerException
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
>>> > > >> e(TemplateDataStoreVO.java:280)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
>>> > > >> rImpl.java:2009)
>>> > > >> > at
>>> > > >> >
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>> > > >> > ive
>>> > > >> > Method)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>> > > >> MethodAccessorImpl.java:62)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>> > > >> legatingMethodAccessorImpl.java:43)
>>> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>> > > >> on(AopUtils.java:344)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>> > > >> inpoint(ReflectiveMethodInvocation.java:198)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > > >> ReflectiveMethodInvocation.java:163)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>> > > >> e(ExposeInvocationInterceptor.java:97)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > > >> ReflectiveMethodInvocation.java:186)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>> > > >> cAopProxy.java:215)
>>> > > >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>> > > >> eTemplatedVolume(VolumeOrchestrator.java:834)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>> > > >> eTemplatedVolumes(VolumeOrchestrator.java:954)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
>>> > > >> (VirtualMachineManagerImpl.java:496)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>> > > >> action(TransactionCallbackWithExceptionNoReturn.java:25)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>> > > >> action(TransactionCallbackWithExceptionNoReturn.java:21)
>>> > > >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>> > > >> Impl.java:471)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>> > > >> Impl.java:528)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
>>> > > >> s(VpcNetworkHelperImpl.java:169)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
>>> > > >> Impl.java:520)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
>>> > > >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
>>> > > >> eDeployment(RouterDeploymentDefinition.java:377)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
>>> > > >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
>>> > > >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
>>> > > >> VirtualRouter(RouterDeploymentDefinition.java:205)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
>>> > > >> lRouterElement.java:215)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>> > > >> entNetworkElements(NetworkOrchestrator.java:1488)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>> > > >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
>>> > > >> tNetwork(NetworkOrchestrator.java:3302)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>> > > >> l.java:2068)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>> > > >> l.java:2089)
>>> > > >> > at
>>> > > >> >
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>> > > >> > ive
>>> > > >> > Method)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>> > > >> MethodAccessorImpl.java:62)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>> > > >> legatingMethodAccessorImpl.java:43)
>>> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>> > > >> on(AopUtils.java:344)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>> > > >> inpoint(ReflectiveMethodInvocation.java:198)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > > >> ReflectiveMethodInvocation.java:163)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
>>> > > >> erceptor.invoke(EventUtils.java:107)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > > >> ReflectiveMethodInvocation.java:175)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
>>> > > >> java:51)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > > >> ReflectiveMethodInvocation.java:175)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>> > > >> e(ExposeInvocationInterceptor.java:97)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > > >> ReflectiveMethodInvocation.java:186)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>> > > >> cAopProxy.java:215)
>>> > > >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
>>> > > >> ute(RestartNetworkCmd.java:98)
>>> > > >> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
>>> > > >> :108)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
>>> > > >> Context(AsyncJobManagerImpl.java:620)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
>>> > > >> nagedContextRunnable.java:48)
>>> > > >> > at
>>> > > >> >
>>> > > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$
>>> 1.ca
>>> > > >> ll(DefaultManagedContext.java:55)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
>>> > > >> WithContext(DefaultManagedContext.java:102)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
>>> > > >> ithContext(DefaultManagedContext.java:52)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
>>> > > >> gedContextRunnable.java:45)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
>>> > > >> syncJobManagerImpl.java:568)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
>>> > > >> rs.java:515)
>>> > > >> > at
>>> > > >> >
>>> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
>>> > > >> lExecutor.java:1128)
>>> > > >> > at
>>> > > >> >
>>> > > >>
>>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
>>> > > >> olExecutor.java:628)
>>> > > >> > at java.base/java.lang.Thread.run(Thread.java:829)
>>> > > >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > > >> (logid:6b6b9867)
>>> > > >> > Network id=249 failed to restart.
>>> > > >> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>> > > >> > Complete
>>> > > >> async
>>> > > >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
>>> > > >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
>>> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>> > > >> > Publish
>>> > > >> async
>>> > > >> > job-3342 complete on message bus
>>> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>> Wake
>>> > > >> > up
>>> > > >> jobs
>>> > > >> > related to job-3342
>>> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>> Update
>>> > > >> > db status for job-3342
>>> > > >> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>> Wake
>>> > > >> > up
>>> > > >> jobs
>>> > > >> > joined with job-3342 and disjoin all subjobs created from job-
>>> 3342
>>> > > >> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>> Done
>>> > > >> executing
>>> > > >> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
>>> > > >> > for
>>> > > >> > job-3342
>>> > > >> >
>>> > > >> > Regards,
>>> > > >> > Chris
>>> > > >> >
>>> > > >>
>>> > > >
>>> > >
>>> >
>>>
>>

Re: VR for VPC won't start anymore

Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
hi slavka,
i checked the log and didn't found anything like "failed to read from
template.properties".

Just for understanding:
When deploying a new "systemvm"-template, which i normally would do while
upgardeing mi CS-Environment, the values of the template.properties will be
transfaired into DB. The management server will then make use of the values
which are stored in the DB?

i destroyed the "stopped" router in my installation and triggered a
re-deployment. The term "template" is mentioned inside the logs only for
two reasons:
1. Successfull router health check of the running router (the primary one
of my vpc)
2. In the mentioned error log
" at
org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSize(TemplateDataStoreVO.java:280)
        at
com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManagerImpl.java:2009)
"

so the question for me is  - can i manually place the missing values in the
DB, so that the template is useable again? Or will i wait until i upgrade
to 4.17.1 - which might bring a new systemVM template which will then be
seeded again ?

Regards,
Chris

Am Do., 4. Aug. 2022 um 19:10 Uhr schrieb Slavka Peleva <
slavkap@storpool.com>:

> Hi Christopher,
>
> For some reason, these fields' values are empty, which probably
> happened while you seed the system VM template.
>
>> qcow2.virtualsize=
>> virtualsize=
>> qcow2.size=
>
>
> From the DB record, the only option for the values of physical_size = 0
> and size=Null, is that CS couldn't read the `template.properties` file. Can
> you search in the management log file for a message like "Failed to read
> from template.properties"? It should contain more detailed information
> about the failure.
>
> Best regards,
> Slavka
>
> On Thu, Aug 4, 2022 at 7:13 PM Vash_X@gmx.de <Va...@gmx.de> wrote:
>
>> Hi everyone -
>>
>> @Gary
>> thanks for your input
>>
>> @Wei ZHOU <us...@gmail.com>
>> Yes, the image is completely downloaded to the imagestore. I also checked
>> the availeabilty on the storage beneath - everything seems to be in place
>> like it should
>>
>> Following the values out ouf the db you requested:
>> id= 18
>> store_id = 1
>> download_pct = 100
>> size = "NULL"
>> store_role = Image
>> physical_size = 0
>> download_state = DOWNLOADED
>> state = READY
>> install_path =
>> /template/tmpl/1/212/0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>
>> @Slavka
>> Following the information of the 'template.properties'
>>
>> filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>> description=SystemVM Template ( kvm )
>> hvm=false
>> size=460067328
>> qcow2=true
>> id=212
>> public=true
>> qcow2.filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>> uniquename=routing-212
>> qcow2.virtualsize=
>> virtualsize=
>> qcow2.size=
>>
>> Regards,
>> Chris
>>
>> Am Do., 4. Aug. 2022 um 12:05 Uhr schrieb Slavka Peleva
>> <sl...@storpool.com.invalid>:
>>
>> > Hi Christopher,
>> >
>> > Can you share the information of the `template.properties` file located
>> on
>> > your secondary storage, where the template file is downloaded? You can
>> find
>> > the path in the template_store_ref tabled - install_path.
>> >
>> > Best regards,
>> > Slavka
>> >
>> > On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Gary.Dixon@quadris.co.uk
>> > .invalid>
>> > wrote:
>> >
>> > > Hi Christopher
>> > >
>> > > My values show :
>> > > size=2621440000 physical size=375471104 and this is for a 4.15.1
>> systemVM
>> > > template
>> > >
>> > > BR
>> > > Gary
>> > >
>> > > Gary Dixon​
>> > > Senior Technical Consultant
>> > > T:  *0161 537 4980* <0161%20537%204980>
>> > > W: www.quadris.co.uk
>> > > The information contained in this e-mail from Quadris may be
>> confidential
>> > > and privileged for the private use of the named recipient.  The
>> contents
>> > of
>> > > this e-mail may not necessarily represent the official views of
>> Quadris.
>> > > If you have received this information in error you must not copy,
>> > > distribute or take any action or reliance on its contents.  Please
>> > destroy
>> > > any hard copies and delete this message.
>> > > -----Original Message-----
>> > > From: Vash_X@gmx.de <Va...@gmx.de>
>> > > Sent: 04 August 2022 09:40
>> > > To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
>> > > Subject: Re: VR for VPC won't start anymore
>> > >
>> > > I forgot to ask - might anyone take a quick look into the database and
>> > can
>> > > give a hind if the fields are indeed "filled" with values
>> > > (template_store_res.size / template_store_res.physical_size)?
>> > > Another question for understanding would be the difference of the
>> values
>> > -
>> > > physical size is the actual amount of data on a datasystemlevel - but
>> > what
>> > > represents the value of "size"?
>> > >
>> > > Regards,
>> > > Christopher
>> > >
>> > > Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <
>> Vash_X@gmx.de>:
>> > >
>> > > > Wei, seems like you are heading twards the right direction - like
>> > always.
>> > > >
>> > > > i took a look into the "template_store_res" table... and guess:
>> There
>> > > > is a entry for the current systemvmtemplate-4.16.1. How ever: The
>> > > > field for "size" ist "null" and "physical_size" is "0".
>> > > >
>> > > > Might this be the reason for the " java.lang.NullPointerException" ?
>> > > >
>> > > > Regards,
>> > > > Chris
>> > > >
>> > > > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
>> > > > <ustcweizhou@gmail.com
>> > > > >:
>> > > >
>> > > >> It looks there is no entry in template_store_ref table for the
>> > > >> systemvm template
>> > > >>
>> > > >> -Wei
>> > > >>
>> > > >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
>> > > >>
>> > > >> > Hi everyone,
>> > > >> >
>> > > >> > faceing currently some challanges regarding my network
>> > > >> > configuration in
>> > > >> CS
>> > > >> > 4.16.1.
>> > > >> >
>> > > >> > Setup:
>> > > >> > VPC with redundant routers and some tiers as well as an private
>> > > gateway.
>> > > >> >
>> > > >> > Today i wanted to restart the whole VPC - sadly only one vrouter
>> > > >> > "survived" .... Currently i can't depoly any networks in or
>> outside
>> > > >> > the VPC. Also the second router shall be delployed but keeps in
>> the
>> > > >> > stopped state.
>> > > >> > I really dont have a clue where to look at first...
>> > > >> >
>> > > >> > here the logfile from the Management-Server:
>> > > >> >
>> > > >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating the VR with id=74 in datacenter Zone {"id": "1",
>> "name":
>> > > >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
>> > > >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Adding nic for Virtual Router in Control network
>> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Found existing network configuration for offering [Network
>> Offering
>> > > >> > [3-Control-System-Control-Network]: Ntwk[202|>
>> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Releasing lock for
>> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>> {"id":
>> > > >> > 1, "name": "system", "uuid>
>> > > >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Adding nic for Virtual Router in Public network
>> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Found existing network configuration for offering [Network
>> Offering
>> > > >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
>> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Releasing lock for
>> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>> {"id":
>> > > >> > 1, "name": "system", "uuid>
>> > > >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
>> > > >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
>> > > >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Rolling back the transaction: Time = 0 Name =
>> API-Job-Executor-60;
>> > > >> called
>> > > >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
>> > > >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=236
>> > > >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > allocating virtual machine from
>> > > >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with
>> hostname:r-74-VM
>> > > >> > and
>> > > >> 12
>> > > >> > netw>
>> > > >> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating entries for VM: VM instance {id: "74", name:
>> "r-74-VM",
>> > > uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
>> > > >> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=249
>> > > >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=236
>> > > >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=240
>> > > >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=241
>> > > >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=242
>> > > >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=243
>> > > >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=244
>> > > >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=245
>> > > >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=246
>> > > >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > > >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Service SecurityGroup is not supported in the network id=247
>> > > >> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Allocating disks for VM instance {id: "74", name: "r-74-VM",
>> uuid:
>> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
>> > > >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > adding disk object ROOT-74 to r-74-VM
>> > > >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Rolling back the transaction: Time = 234 Name =
>> > > >> > API-Job-Executor-60; called by
>> > > >> > -TransactionLegacy.rollback:888-Transacti>
>> > > >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Failed to implement network Ntwk[249|Guest|30] elements and
>> > > >> > resources
>> > > >> as a
>> > > >> > part of network restart due to
>> > > >> > java.lang.NullPointerException
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
>> > > >> e(TemplateDataStoreVO.java:280)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
>> > > >> rImpl.java:2009)
>> > > >> > at
>> > > >> >
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>> > > >> > ive
>> > > >> > Method)
>> > > >> > at
>> > > >> >
>> > > >>
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>> > > >> MethodAccessorImpl.java:62)
>> > > >> > at
>> > > >> >
>> > > >>
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>> > > >> legatingMethodAccessorImpl.java:43)
>> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>> > > >> on(AopUtils.java:344)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>> > > >> inpoint(ReflectiveMethodInvocation.java:198)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> > > >> ReflectiveMethodInvocation.java:163)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>> > > >> e(ExposeInvocationInterceptor.java:97)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> > > >> ReflectiveMethodInvocation.java:186)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>> > > >> cAopProxy.java:215)
>> > > >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>> > > >> eTemplatedVolume(VolumeOrchestrator.java:834)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>> > > >> eTemplatedVolumes(VolumeOrchestrator.java:954)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
>> > > >> (VirtualMachineManagerImpl.java:496)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>> > > >> action(TransactionCallbackWithExceptionNoReturn.java:25)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>> > > >> action(TransactionCallbackWithExceptionNoReturn.java:21)
>> > > >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>> > > >> Impl.java:471)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>> > > >> Impl.java:528)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
>> > > >> s(VpcNetworkHelperImpl.java:169)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
>> > > >> Impl.java:520)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
>> > > >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
>> > > >> eDeployment(RouterDeploymentDefinition.java:377)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
>> > > >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
>> > > >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
>> > > >> VirtualRouter(RouterDeploymentDefinition.java:205)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
>> > > >> lRouterElement.java:215)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>> > > >> entNetworkElements(NetworkOrchestrator.java:1488)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>> > > >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
>> > > >> tNetwork(NetworkOrchestrator.java:3302)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>> > > >> l.java:2068)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>> > > >> l.java:2089)
>> > > >> > at
>> > > >> >
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>> > > >> > ive
>> > > >> > Method)
>> > > >> > at
>> > > >> >
>> > > >>
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>> > > >> MethodAccessorImpl.java:62)
>> > > >> > at
>> > > >> >
>> > > >>
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>> > > >> legatingMethodAccessorImpl.java:43)
>> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>> > > >> on(AopUtils.java:344)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>> > > >> inpoint(ReflectiveMethodInvocation.java:198)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> > > >> ReflectiveMethodInvocation.java:163)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
>> > > >> erceptor.invoke(EventUtils.java:107)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> > > >> ReflectiveMethodInvocation.java:175)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
>> > > >> java:51)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> > > >> ReflectiveMethodInvocation.java:175)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>> > > >> e(ExposeInvocationInterceptor.java:97)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> > > >> ReflectiveMethodInvocation.java:186)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>> > > >> cAopProxy.java:215)
>> > > >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
>> > > >> ute(RestartNetworkCmd.java:98)
>> > > >> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>> > > >> > at
>> > > >> >
>> > > >>
>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
>> > > >> :108)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
>> > > >> Context(AsyncJobManagerImpl.java:620)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
>> > > >> nagedContextRunnable.java:48)
>> > > >> > at
>> > > >> >
>> > > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$
>> 1.ca
>> > > >> ll(DefaultManagedContext.java:55)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
>> > > >> WithContext(DefaultManagedContext.java:102)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
>> > > >> ithContext(DefaultManagedContext.java:52)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
>> > > >> gedContextRunnable.java:45)
>> > > >> > at
>> > > >> >
>> > > >>
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
>> > > >> syncJobManagerImpl.java:568)
>> > > >> > at
>> > > >> >
>> > > >>
>> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
>> > > >> rs.java:515)
>> > > >> > at
>> > > >> >
>> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>> > > >> > at
>> > > >> >
>> > > >>
>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
>> > > >> lExecutor.java:1128)
>> > > >> > at
>> > > >> >
>> > > >>
>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
>> > > >> olExecutor.java:628)
>> > > >> > at java.base/java.lang.Thread.run(Thread.java:829)
>> > > >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> > > >> (logid:6b6b9867)
>> > > >> > Network id=249 failed to restart.
>> > > >> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>> > > >> > Complete
>> > > >> async
>> > > >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
>> > > >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
>> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>> > > >> > Publish
>> > > >> async
>> > > >> > job-3342 complete on message bus
>> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
>> > > >> > up
>> > > >> jobs
>> > > >> > related to job-3342
>> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>> Update
>> > > >> > db status for job-3342
>> > > >> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
>> > > >> > up
>> > > >> jobs
>> > > >> > joined with job-3342 and disjoin all subjobs created from job-
>> 3342
>> > > >> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done
>> > > >> executing
>> > > >> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
>> > > >> > for
>> > > >> > job-3342
>> > > >> >
>> > > >> > Regards,
>> > > >> > Chris
>> > > >> >
>> > > >>
>> > > >
>> > >
>> >
>>
>

Re: VR for VPC won't start anymore

Posted by Slavka Peleva <sl...@storpool.com.INVALID>.
Hi Christopher,

For some reason, these fields' values are empty, which probably
happened while you seed the system VM template.

> qcow2.virtualsize=
> virtualsize=
> qcow2.size=


From the DB record, the only option for the values of physical_size = 0 and
size=Null, is that CS couldn't read the `template.properties` file. Can you
search in the management log file for a message like "Failed to read from
template.properties"? It should contain more detailed information about the
failure.

Best regards,
Slavka

On Thu, Aug 4, 2022 at 7:13 PM Vash_X@gmx.de <Va...@gmx.de> wrote:

> Hi everyone -
>
> @Gary
> thanks for your input
>
> @Wei ZHOU <us...@gmail.com>
> Yes, the image is completely downloaded to the imagestore. I also checked
> the availeabilty on the storage beneath - everything seems to be in place
> like it should
>
> Following the values out ouf the db you requested:
> id= 18
> store_id = 1
> download_pct = 100
> size = "NULL"
> store_role = Image
> physical_size = 0
> download_state = DOWNLOADED
> state = READY
> install_path =
> /template/tmpl/1/212/0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>
> @Slavka
> Following the information of the 'template.properties'
>
> filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
> description=SystemVM Template ( kvm )
> hvm=false
> size=460067328
> qcow2=true
> id=212
> public=true
> qcow2.filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
> uniquename=routing-212
> qcow2.virtualsize=
> virtualsize=
> qcow2.size=
>
> Regards,
> Chris
>
> Am Do., 4. Aug. 2022 um 12:05 Uhr schrieb Slavka Peleva
> <sl...@storpool.com.invalid>:
>
> > Hi Christopher,
> >
> > Can you share the information of the `template.properties` file located
> on
> > your secondary storage, where the template file is downloaded? You can
> find
> > the path in the template_store_ref tabled - install_path.
> >
> > Best regards,
> > Slavka
> >
> > On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Gary.Dixon@quadris.co.uk
> > .invalid>
> > wrote:
> >
> > > Hi Christopher
> > >
> > > My values show :
> > > size=2621440000 physical size=375471104 and this is for a 4.15.1
> systemVM
> > > template
> > >
> > > BR
> > > Gary
> > >
> > > Gary Dixon​
> > > Senior Technical Consultant
> > > T:  *0161 537 4980* <0161%20537%204980>
> > > W: www.quadris.co.uk
> > > The information contained in this e-mail from Quadris may be
> confidential
> > > and privileged for the private use of the named recipient.  The
> contents
> > of
> > > this e-mail may not necessarily represent the official views of
> Quadris.
> > > If you have received this information in error you must not copy,
> > > distribute or take any action or reliance on its contents.  Please
> > destroy
> > > any hard copies and delete this message.
> > > -----Original Message-----
> > > From: Vash_X@gmx.de <Va...@gmx.de>
> > > Sent: 04 August 2022 09:40
> > > To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
> > > Subject: Re: VR for VPC won't start anymore
> > >
> > > I forgot to ask - might anyone take a quick look into the database and
> > can
> > > give a hind if the fields are indeed "filled" with values
> > > (template_store_res.size / template_store_res.physical_size)?
> > > Another question for understanding would be the difference of the
> values
> > -
> > > physical size is the actual amount of data on a datasystemlevel - but
> > what
> > > represents the value of "size"?
> > >
> > > Regards,
> > > Christopher
> > >
> > > Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <Vash_X@gmx.de
> >:
> > >
> > > > Wei, seems like you are heading twards the right direction - like
> > always.
> > > >
> > > > i took a look into the "template_store_res" table... and guess: There
> > > > is a entry for the current systemvmtemplate-4.16.1. How ever: The
> > > > field for "size" ist "null" and "physical_size" is "0".
> > > >
> > > > Might this be the reason for the " java.lang.NullPointerException" ?
> > > >
> > > > Regards,
> > > > Chris
> > > >
> > > > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
> > > > <ustcweizhou@gmail.com
> > > > >:
> > > >
> > > >> It looks there is no entry in template_store_ref table for the
> > > >> systemvm template
> > > >>
> > > >> -Wei
> > > >>
> > > >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
> > > >>
> > > >> > Hi everyone,
> > > >> >
> > > >> > faceing currently some challanges regarding my network
> > > >> > configuration in
> > > >> CS
> > > >> > 4.16.1.
> > > >> >
> > > >> > Setup:
> > > >> > VPC with redundant routers and some tiers as well as an private
> > > gateway.
> > > >> >
> > > >> > Today i wanted to restart the whole VPC - sadly only one vrouter
> > > >> > "survived" .... Currently i can't depoly any networks in or
> outside
> > > >> > the VPC. Also the second router shall be delployed but keeps in
> the
> > > >> > stopped state.
> > > >> > I really dont have a clue where to look at first...
> > > >> >
> > > >> > here the logfile from the Management-Server:
> > > >> >
> > > >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating the VR with id=74 in datacenter Zone {"id": "1",
> "name":
> > > >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
> > > >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Adding nic for Virtual Router in Control network
> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Found existing network configuration for offering [Network
> Offering
> > > >> > [3-Control-System-Control-Network]: Ntwk[202|>
> > > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Releasing lock for
> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
> {"id":
> > > >> > 1, "name": "system", "uuid>
> > > >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Adding nic for Virtual Router in Public network
> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Found existing network configuration for offering [Network
> Offering
> > > >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
> > > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Releasing lock for
> > > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
> {"id":
> > > >> > 1, "name": "system", "uuid>
> > > >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
> > > >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
> > > >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Rolling back the transaction: Time = 0 Name = API-Job-Executor-60;
> > > >> called
> > > >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
> > > >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=236
> > > >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > allocating virtual machine from
> > > >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with
> hostname:r-74-VM
> > > >> > and
> > > >> 12
> > > >> > netw>
> > > >> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating entries for VM: VM instance {id: "74", name: "r-74-VM",
> > > uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
> > > >> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=249
> > > >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=236
> > > >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=240
> > > >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=241
> > > >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=242
> > > >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=243
> > > >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=244
> > > >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=245
> > > >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=246
> > > >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
> uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > > >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Service SecurityGroup is not supported in the network id=247
> > > >> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Allocating disks for VM instance {id: "74", name: "r-74-VM", uuid:
> > > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
> > > >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > adding disk object ROOT-74 to r-74-VM
> > > >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Rolling back the transaction: Time = 234 Name =
> > > >> > API-Job-Executor-60; called by
> > > >> > -TransactionLegacy.rollback:888-Transacti>
> > > >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Failed to implement network Ntwk[249|Guest|30] elements and
> > > >> > resources
> > > >> as a
> > > >> > part of network restart due to
> > > >> > java.lang.NullPointerException
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
> > > >> e(TemplateDataStoreVO.java:280)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
> > > >> rImpl.java:2009)
> > > >> > at
> > > >> >
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
> > > >> > ive
> > > >> > Method)
> > > >> > at
> > > >> >
> > > >>
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
> > > >> MethodAccessorImpl.java:62)
> > > >> > at
> > > >> >
> > > >>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
> > > >> legatingMethodAccessorImpl.java:43)
> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
> > > >> on(AopUtils.java:344)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
> > > >> inpoint(ReflectiveMethodInvocation.java:198)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > > >> ReflectiveMethodInvocation.java:163)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
> > > >> e(ExposeInvocationInterceptor.java:97)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > > >> ReflectiveMethodInvocation.java:186)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
> > > >> cAopProxy.java:215)
> > > >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
> > > >> eTemplatedVolume(VolumeOrchestrator.java:834)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
> > > >> eTemplatedVolumes(VolumeOrchestrator.java:954)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
> > > >> (VirtualMachineManagerImpl.java:496)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
> > > >> action(TransactionCallbackWithExceptionNoReturn.java:25)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
> > > >> action(TransactionCallbackWithExceptionNoReturn.java:21)
> > > >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
> > > >> Impl.java:471)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
> > > >> Impl.java:528)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
> > > >> s(VpcNetworkHelperImpl.java:169)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
> > > >> Impl.java:520)
> > > >> > at
> > > >> >
> > > >>
> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
> > > >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
> > > >> > at
> > > >> >
> > > >>
> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
> > > >> eDeployment(RouterDeploymentDefinition.java:377)
> > > >> > at
> > > >> >
> > > >>
> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
> > > >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
> > > >> > at
> > > >> >
> > > >>
> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
> > > >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
> > > >> > at
> > > >> >
> > > >>
> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
> > > >> VirtualRouter(RouterDeploymentDefinition.java:205)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
> > > >> lRouterElement.java:215)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
> > > >> entNetworkElements(NetworkOrchestrator.java:1488)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
> > > >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
> > > >> tNetwork(NetworkOrchestrator.java:3302)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
> > > >> l.java:2068)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
> > > >> l.java:2089)
> > > >> > at
> > > >> >
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
> > > >> > ive
> > > >> > Method)
> > > >> > at
> > > >> >
> > > >>
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
> > > >> MethodAccessorImpl.java:62)
> > > >> > at
> > > >> >
> > > >>
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
> > > >> legatingMethodAccessorImpl.java:43)
> > > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
> > > >> on(AopUtils.java:344)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
> > > >> inpoint(ReflectiveMethodInvocation.java:198)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > > >> ReflectiveMethodInvocation.java:163)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
> > > >> erceptor.invoke(EventUtils.java:107)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > > >> ReflectiveMethodInvocation.java:175)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
> > > >> java:51)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > > >> ReflectiveMethodInvocation.java:175)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
> > > >> e(ExposeInvocationInterceptor.java:97)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > > >> ReflectiveMethodInvocation.java:186)
> > > >> > at
> > > >> >
> > > >>
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
> > > >> cAopProxy.java:215)
> > > >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
> > > >> ute(RestartNetworkCmd.java:98)
> > > >> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
> > > >> > at
> > > >> >
> > > >>
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
> > > >> :108)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
> > > >> Context(AsyncJobManagerImpl.java:620)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
> > > >> nagedContextRunnable.java:48)
> > > >> > at
> > > >> >
> > > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$
> 1.ca
> > > >> ll(DefaultManagedContext.java:55)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
> > > >> WithContext(DefaultManagedContext.java:102)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
> > > >> ithContext(DefaultManagedContext.java:52)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
> > > >> gedContextRunnable.java:45)
> > > >> > at
> > > >> >
> > > >>
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
> > > >> syncJobManagerImpl.java:568)
> > > >> > at
> > > >> >
> > > >>
> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
> > > >> rs.java:515)
> > > >> > at
> > > >> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> > > >> > at
> > > >> >
> > > >>
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
> > > >> lExecutor.java:1128)
> > > >> > at
> > > >> >
> > > >>
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
> > > >> olExecutor.java:628)
> > > >> > at java.base/java.lang.Thread.run(Thread.java:829)
> > > >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > > >> (logid:6b6b9867)
> > > >> > Network id=249 failed to restart.
> > > >> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
> > > >> > Complete
> > > >> async
> > > >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
> > > >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
> > > >> > Publish
> > > >> async
> > > >> > job-3342 complete on message bus
> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
> > > >> > up
> > > >> jobs
> > > >> > related to job-3342
> > > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
> Update
> > > >> > db status for job-3342
> > > >> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
> > > >> > up
> > > >> jobs
> > > >> > joined with job-3342 and disjoin all subjobs created from job-
> 3342
> > > >> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done
> > > >> executing
> > > >> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
> > > >> > for
> > > >> > job-3342
> > > >> >
> > > >> > Regards,
> > > >> > Chris
> > > >> >
> > > >>
> > > >
> > >
> >
>

Re: VR for VPC won't start anymore

Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
Good evening everyone,

got everything working as expected. Resolved this by restarting the VPC
with the clean-up option.... Could have thought about this before....
But everything seems back to normal and working as expected.

Thanks for your support - as always really helpfull! Until the next topic -

Regards,
Chris

Am Fr., 5. Aug. 2022 um 17:45 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:

>
> Hi everyone,
>
> @Slavka Peleva <sl...@storpool.com>
> Thx for your efforts here - i decided to go with the DB-manipulation first
> as i wanted to make shure that i don't have any impact on other existing
> vms.
>
> @Wei ZHOU <us...@gmail.com>
> Inserted the values into template.properties as well as the database.
>
> Result:
> Router is deployed again
>
> BUT:
>
> now the newly started router and the old one aren't communicationg
> properly which one is prime and which one is second. Leading to the
> situation where i have to prime routers for one VPC - which isn't helpful
> by any means.
> Looking in the DB (vpc_gateways), both routers are in Primary state...
> So for now i destroyed the old router, hopeing that the HA-Scripts for the
> VPC will trigger creation of a new one again....
>
> Regards,
> Chris
>
> Am Fr., 5. Aug. 2022 um 13:54 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:
>
>> Hi Wei,
>>
>> whatever it was / is - guess i will try this.
>> I also found another reference for the template size in 'vm_template' -
>> guess i shall update this one as well manually...
>>
>> Regards,
>> Chris
>>
>> Am Fr., 5. Aug. 2022 um 13:01 Uhr schrieb Wei ZHOU <ustcweizhou@gmail.com
>> >:
>>
>>> Hi,
>>>
>>> It might be because qemu-img is not installed on your management server.
>>>
>>> You can update the template.properties and database manually.
>>>
>>> -Wei
>>>
>>> On Thu, 4 Aug 2022 at 18:13, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>>
>>>> Hi everyone -
>>>>
>>>> @Gary
>>>> thanks for your input
>>>>
>>>> @Wei ZHOU <us...@gmail.com>
>>>> Yes, the image is completely downloaded to the imagestore. I also
>>>> checked the availeabilty on the storage beneath - everything seems to be in
>>>> place like it should
>>>>
>>>> Following the values out ouf the db you requested:
>>>> id= 18
>>>> store_id = 1
>>>> download_pct = 100
>>>> size = "NULL"
>>>> store_role = Image
>>>> physical_size = 0
>>>> download_state = DOWNLOADED
>>>> state = READY
>>>> install_path =
>>>> /template/tmpl/1/212/0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>>
>>>> @Slavka
>>>> Following the information of the 'template.properties'
>>>>
>>>> filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>> description=SystemVM Template ( kvm )
>>>> hvm=false
>>>> size=460067328
>>>> qcow2=true
>>>> id=212
>>>> public=true
>>>> qcow2.filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>> uniquename=routing-212
>>>> qcow2.virtualsize=
>>>> virtualsize=
>>>> qcow2.size=
>>>>
>>>> Regards,
>>>> Chris
>>>>
>>>> Am Do., 4. Aug. 2022 um 12:05 Uhr schrieb Slavka Peleva
>>>> <sl...@storpool.com.invalid>:
>>>>
>>>>> Hi Christopher,
>>>>>
>>>>> Can you share the information of the `template.properties` file
>>>>> located on
>>>>> your secondary storage, where the template file is downloaded? You can
>>>>> find
>>>>> the path in the template_store_ref tabled - install_path.
>>>>>
>>>>> Best regards,
>>>>> Slavka
>>>>>
>>>>> On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Gary.Dixon@quadris.co.uk
>>>>> .invalid>
>>>>> wrote:
>>>>>
>>>>> > Hi Christopher
>>>>> >
>>>>> > My values show :
>>>>> > size=2621440000 physical size=375471104 and this is for a 4.15.1
>>>>> systemVM
>>>>> > template
>>>>> >
>>>>> > BR
>>>>> > Gary
>>>>> >
>>>>> > Gary Dixon
>>>>> > Senior Technical Consultant
>>>>> > T:  *0161 537 4980* <0161%20537%204980>
>>>>> > W: www.quadris.co.uk
>>>>> > The information contained in this e-mail from Quadris may be
>>>>> confidential
>>>>> > and privileged for the private use of the named recipient.  The
>>>>> contents of
>>>>> > this e-mail may not necessarily represent the official views of
>>>>> Quadris.
>>>>> > If you have received this information in error you must not copy,
>>>>> > distribute or take any action or reliance on its contents.  Please
>>>>> destroy
>>>>> > any hard copies and delete this message.
>>>>> > -----Original Message-----
>>>>> > From: Vash_X@gmx.de <Va...@gmx.de>
>>>>> > Sent: 04 August 2022 09:40
>>>>> > To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
>>>>> > Subject: Re: VR for VPC won't start anymore
>>>>> >
>>>>> > I forgot to ask - might anyone take a quick look into the database
>>>>> and can
>>>>> > give a hind if the fields are indeed "filled" with values
>>>>> > (template_store_res.size / template_store_res.physical_size)?
>>>>> > Another question for understanding would be the difference of the
>>>>> values -
>>>>> > physical size is the actual amount of data on a datasystemlevel -
>>>>> but what
>>>>> > represents the value of "size"?
>>>>> >
>>>>> > Regards,
>>>>> > Christopher
>>>>> >
>>>>> > Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <
>>>>> Vash_X@gmx.de>:
>>>>> >
>>>>> > > Wei, seems like you are heading twards the right direction - like
>>>>> always.
>>>>> > >
>>>>> > > i took a look into the "template_store_res" table... and guess:
>>>>> There
>>>>> > > is a entry for the current systemvmtemplate-4.16.1. How ever: The
>>>>> > > field for "size" ist "null" and "physical_size" is "0".
>>>>> > >
>>>>> > > Might this be the reason for the " java.lang.NullPointerException"
>>>>> ?
>>>>> > >
>>>>> > > Regards,
>>>>> > > Chris
>>>>> > >
>>>>> > > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
>>>>> > > <ustcweizhou@gmail.com
>>>>> > > >:
>>>>> > >
>>>>> > >> It looks there is no entry in template_store_ref table for the
>>>>> > >> systemvm template
>>>>> > >>
>>>>> > >> -Wei
>>>>> > >>
>>>>> > >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>>>> > >>
>>>>> > >> > Hi everyone,
>>>>> > >> >
>>>>> > >> > faceing currently some challanges regarding my network
>>>>> > >> > configuration in
>>>>> > >> CS
>>>>> > >> > 4.16.1.
>>>>> > >> >
>>>>> > >> > Setup:
>>>>> > >> > VPC with redundant routers and some tiers as well as an private
>>>>> > gateway.
>>>>> > >> >
>>>>> > >> > Today i wanted to restart the whole VPC - sadly only one vrouter
>>>>> > >> > "survived" .... Currently i can't depoly any networks in or
>>>>> outside
>>>>> > >> > the VPC. Also the second router shall be delployed but keeps in
>>>>> the
>>>>> > >> > stopped state.
>>>>> > >> > I really dont have a clue where to look at first...
>>>>> > >> >
>>>>> > >> > here the logfile from the Management-Server:
>>>>> > >> >
>>>>> > >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating the VR with id=74 in datacenter Zone {"id": "1",
>>>>> "name":
>>>>> > >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
>>>>> > >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Adding nic for Virtual Router in Control network
>>>>> > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Found existing network configuration for offering [Network
>>>>> Offering
>>>>> > >> > [3-Control-System-Control-Network]: Ntwk[202|>
>>>>> > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Releasing lock for
>>>>> > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>>>> {"id":
>>>>> > >> > 1, "name": "system", "uuid>
>>>>> > >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Adding nic for Virtual Router in Public network
>>>>> > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Found existing network configuration for offering [Network
>>>>> Offering
>>>>> > >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
>>>>> > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Releasing lock for
>>>>> > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>>>> {"id":
>>>>> > >> > 1, "name": "system", "uuid>
>>>>> > >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
>>>>> > >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Adding nic for Virtual Router in Guest network
>>>>> Ntwk[249|Guest|30]
>>>>> > >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Rolling back the transaction: Time = 0 Name =
>>>>> API-Job-Executor-60;
>>>>> > >> called
>>>>> > >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
>>>>> > >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=236
>>>>> > >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > allocating virtual machine from
>>>>> > >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with
>>>>> hostname:r-74-VM
>>>>> > >> > and
>>>>> > >> 12
>>>>> > >> > netw>
>>>>> > >> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating entries for VM: VM instance {id: "74", name:
>>>>> "r-74-VM",
>>>>> > uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
>>>>> > >> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nics for VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=249
>>>>> > >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=236
>>>>> > >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=240
>>>>> > >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=241
>>>>> > >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=242
>>>>> > >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=243
>>>>> > >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=244
>>>>> > >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=245
>>>>> > >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=246
>>>>> > >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>>> > >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Service SecurityGroup is not supported in the network id=247
>>>>> > >> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Allocating disks for VM instance {id: "74", name: "r-74-VM",
>>>>> uuid:
>>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
>>>>> > >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > adding disk object ROOT-74 to r-74-VM
>>>>> > >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Rolling back the transaction: Time = 234 Name =
>>>>> > >> > API-Job-Executor-60; called by
>>>>> > >> > -TransactionLegacy.rollback:888-Transacti>
>>>>> > >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Failed to implement network Ntwk[249|Guest|30] elements and
>>>>> > >> > resources
>>>>> > >> as a
>>>>> > >> > part of network restart due to
>>>>> > >> > java.lang.NullPointerException
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
>>>>> > >> e(TemplateDataStoreVO.java:280)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
>>>>> > >> rImpl.java:2009)
>>>>> > >> > at
>>>>> > >> >
>>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>>>> > >> > ive
>>>>> > >> > Method)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>>>> > >> MethodAccessorImpl.java:62)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>>>> > >> legatingMethodAccessorImpl.java:43)
>>>>> > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>>>> > >> on(AopUtils.java:344)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>>>> > >> inpoint(ReflectiveMethodInvocation.java:198)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > >> ReflectiveMethodInvocation.java:163)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>>>> > >> e(ExposeInvocationInterceptor.java:97)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > >> ReflectiveMethodInvocation.java:186)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>>>> > >> cAopProxy.java:215)
>>>>> > >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>>>> > >> eTemplatedVolume(VolumeOrchestrator.java:834)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>>>> > >> eTemplatedVolumes(VolumeOrchestrator.java:954)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
>>>>> > >> (VirtualMachineManagerImpl.java:496)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>>>> > >> action(TransactionCallbackWithExceptionNoReturn.java:25)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>>>> > >> action(TransactionCallbackWithExceptionNoReturn.java:21)
>>>>> > >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>>>> > >> Impl.java:471)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>>>> > >> Impl.java:528)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
>>>>> > >> s(VpcNetworkHelperImpl.java:169)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
>>>>> > >> Impl.java:520)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
>>>>> > >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
>>>>> > >> eDeployment(RouterDeploymentDefinition.java:377)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
>>>>> > >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
>>>>> > >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
>>>>> > >> VirtualRouter(RouterDeploymentDefinition.java:205)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
>>>>> > >> lRouterElement.java:215)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>>>> > >> entNetworkElements(NetworkOrchestrator.java:1488)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>>>> > >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
>>>>> > >> tNetwork(NetworkOrchestrator.java:3302)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>>>> > >> l.java:2068)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>>>> > >> l.java:2089)
>>>>> > >> > at
>>>>> > >> >
>>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>>>> > >> > ive
>>>>> > >> > Method)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>>>> > >> MethodAccessorImpl.java:62)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>>>> > >> legatingMethodAccessorImpl.java:43)
>>>>> > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>>>> > >> on(AopUtils.java:344)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>>>> > >> inpoint(ReflectiveMethodInvocation.java:198)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > >> ReflectiveMethodInvocation.java:163)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
>>>>> > >> erceptor.invoke(EventUtils.java:107)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > >> ReflectiveMethodInvocation.java:175)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
>>>>> > >> java:51)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > >> ReflectiveMethodInvocation.java:175)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>>>> > >> e(ExposeInvocationInterceptor.java:97)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>>> > >> ReflectiveMethodInvocation.java:186)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>>>> > >> cAopProxy.java:215)
>>>>> > >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
>>>>> > >> ute(RestartNetworkCmd.java:98)
>>>>> > >> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
>>>>> > >> :108)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
>>>>> > >> Context(AsyncJobManagerImpl.java:620)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
>>>>> > >> nagedContextRunnable.java:48)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$
>>>>> 1.ca
>>>>> > >> ll(DefaultManagedContext.java:55)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
>>>>> > >> WithContext(DefaultManagedContext.java:102)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
>>>>> > >> ithContext(DefaultManagedContext.java:52)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
>>>>> > >> gedContextRunnable.java:45)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
>>>>> > >> syncJobManagerImpl.java:568)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
>>>>> > >> rs.java:515)
>>>>> > >> > at
>>>>> > >> >
>>>>> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
>>>>> > >> lExecutor.java:1128)
>>>>> > >> > at
>>>>> > >> >
>>>>> > >>
>>>>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
>>>>> > >> olExecutor.java:628)
>>>>> > >> > at java.base/java.lang.Thread.run(Thread.java:829)
>>>>> > >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>>> > >> (logid:6b6b9867)
>>>>> > >> > Network id=249 failed to restart.
>>>>> > >> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> > >> > Complete
>>>>> > >> async
>>>>> > >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
>>>>> > >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
>>>>> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> > >> > Publish
>>>>> > >> async
>>>>> > >> > job-3342 complete on message bus
>>>>> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> Wake
>>>>> > >> > up
>>>>> > >> jobs
>>>>> > >> > related to job-3342
>>>>> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> Update
>>>>> > >> > db status for job-3342
>>>>> > >> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> Wake
>>>>> > >> > up
>>>>> > >> jobs
>>>>> > >> > joined with job-3342 and disjoin all subjobs created from job-
>>>>> 3342
>>>>> > >> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>>> Done
>>>>> > >> executing
>>>>> > >> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
>>>>> > >> > for
>>>>> > >> > job-3342
>>>>> > >> >
>>>>> > >> > Regards,
>>>>> > >> > Chris
>>>>> > >> >
>>>>> > >>
>>>>> > >
>>>>> >
>>>>>
>>>>

Fwd: VR for VPC won't start anymore

Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
Hi everyone,

@Slavka Peleva <sl...@storpool.com>
Thx for your efforts here - i decided to go with the DB-manipulation first
as i wanted to make shure that i don't have any impact on other existing
vms.

@Wei ZHOU <us...@gmail.com>
Inserted the values into template.properties as well as the database.

Result:
Router is deployed again

BUT:

now the newly started router and the old one aren't communicationg properly
which one is prime and which one is second. Leading to the situation where
i have to prime routers for one VPC - which isn't helpful by any means.
Looking in the DB (vpc_gateways), both routers are in Primary state...
So for now i destroyed the old router, hopeing that the HA-Scripts for the
VPC will trigger creation of a new one again....

Regards,
Chris

Am Fr., 5. Aug. 2022 um 13:54 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:

> Hi Wei,
>
> whatever it was / is - guess i will try this.
> I also found another reference for the template size in 'vm_template' -
> guess i shall update this one as well manually...
>
> Regards,
> Chris
>
> Am Fr., 5. Aug. 2022 um 13:01 Uhr schrieb Wei ZHOU <ustcweizhou@gmail.com
> >:
>
>> Hi,
>>
>> It might be because qemu-img is not installed on your management server.
>>
>> You can update the template.properties and database manually.
>>
>> -Wei
>>
>> On Thu, 4 Aug 2022 at 18:13, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>
>>> Hi everyone -
>>>
>>> @Gary
>>> thanks for your input
>>>
>>> @Wei ZHOU <us...@gmail.com>
>>> Yes, the image is completely downloaded to the imagestore. I also
>>> checked the availeabilty on the storage beneath - everything seems to be in
>>> place like it should
>>>
>>> Following the values out ouf the db you requested:
>>> id= 18
>>> store_id = 1
>>> download_pct = 100
>>> size = "NULL"
>>> store_role = Image
>>> physical_size = 0
>>> download_state = DOWNLOADED
>>> state = READY
>>> install_path =
>>> /template/tmpl/1/212/0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>>
>>> @Slavka
>>> Following the information of the 'template.properties'
>>>
>>> filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>> description=SystemVM Template ( kvm )
>>> hvm=false
>>> size=460067328
>>> qcow2=true
>>> id=212
>>> public=true
>>> qcow2.filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>> uniquename=routing-212
>>> qcow2.virtualsize=
>>> virtualsize=
>>> qcow2.size=
>>>
>>> Regards,
>>> Chris
>>>
>>> Am Do., 4. Aug. 2022 um 12:05 Uhr schrieb Slavka Peleva
>>> <sl...@storpool.com.invalid>:
>>>
>>>> Hi Christopher,
>>>>
>>>> Can you share the information of the `template.properties` file located
>>>> on
>>>> your secondary storage, where the template file is downloaded? You can
>>>> find
>>>> the path in the template_store_ref tabled - install_path.
>>>>
>>>> Best regards,
>>>> Slavka
>>>>
>>>> On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Gary.Dixon@quadris.co.uk
>>>> .invalid>
>>>> wrote:
>>>>
>>>> > Hi Christopher
>>>> >
>>>> > My values show :
>>>> > size=2621440000 physical size=375471104 and this is for a 4.15.1
>>>> systemVM
>>>> > template
>>>> >
>>>> > BR
>>>> > Gary
>>>> >
>>>> > Gary Dixon
>>>> > Senior Technical Consultant
>>>> > T:  *0161 537 4980* <0161%20537%204980>
>>>> > W: www.quadris.co.uk
>>>> > The information contained in this e-mail from Quadris may be
>>>> confidential
>>>> > and privileged for the private use of the named recipient.  The
>>>> contents of
>>>> > this e-mail may not necessarily represent the official views of
>>>> Quadris.
>>>> > If you have received this information in error you must not copy,
>>>> > distribute or take any action or reliance on its contents.  Please
>>>> destroy
>>>> > any hard copies and delete this message.
>>>> > -----Original Message-----
>>>> > From: Vash_X@gmx.de <Va...@gmx.de>
>>>> > Sent: 04 August 2022 09:40
>>>> > To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
>>>> > Subject: Re: VR for VPC won't start anymore
>>>> >
>>>> > I forgot to ask - might anyone take a quick look into the database
>>>> and can
>>>> > give a hind if the fields are indeed "filled" with values
>>>> > (template_store_res.size / template_store_res.physical_size)?
>>>> > Another question for understanding would be the difference of the
>>>> values -
>>>> > physical size is the actual amount of data on a datasystemlevel - but
>>>> what
>>>> > represents the value of "size"?
>>>> >
>>>> > Regards,
>>>> > Christopher
>>>> >
>>>> > Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <
>>>> Vash_X@gmx.de>:
>>>> >
>>>> > > Wei, seems like you are heading twards the right direction - like
>>>> always.
>>>> > >
>>>> > > i took a look into the "template_store_res" table... and guess:
>>>> There
>>>> > > is a entry for the current systemvmtemplate-4.16.1. How ever: The
>>>> > > field for "size" ist "null" and "physical_size" is "0".
>>>> > >
>>>> > > Might this be the reason for the " java.lang.NullPointerException" ?
>>>> > >
>>>> > > Regards,
>>>> > > Chris
>>>> > >
>>>> > > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
>>>> > > <ustcweizhou@gmail.com
>>>> > > >:
>>>> > >
>>>> > >> It looks there is no entry in template_store_ref table for the
>>>> > >> systemvm template
>>>> > >>
>>>> > >> -Wei
>>>> > >>
>>>> > >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>>> > >>
>>>> > >> > Hi everyone,
>>>> > >> >
>>>> > >> > faceing currently some challanges regarding my network
>>>> > >> > configuration in
>>>> > >> CS
>>>> > >> > 4.16.1.
>>>> > >> >
>>>> > >> > Setup:
>>>> > >> > VPC with redundant routers and some tiers as well as an private
>>>> > gateway.
>>>> > >> >
>>>> > >> > Today i wanted to restart the whole VPC - sadly only one vrouter
>>>> > >> > "survived" .... Currently i can't depoly any networks in or
>>>> outside
>>>> > >> > the VPC. Also the second router shall be delployed but keeps in
>>>> the
>>>> > >> > stopped state.
>>>> > >> > I really dont have a clue where to look at first...
>>>> > >> >
>>>> > >> > here the logfile from the Management-Server:
>>>> > >> >
>>>> > >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating the VR with id=74 in datacenter Zone {"id": "1",
>>>> "name":
>>>> > >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
>>>> > >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Adding nic for Virtual Router in Control network
>>>> > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Found existing network configuration for offering [Network
>>>> Offering
>>>> > >> > [3-Control-System-Control-Network]: Ntwk[202|>
>>>> > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Releasing lock for
>>>> > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>>> {"id":
>>>> > >> > 1, "name": "system", "uuid>
>>>> > >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Adding nic for Virtual Router in Public network
>>>> > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Found existing network configuration for offering [Network
>>>> Offering
>>>> > >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
>>>> > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Releasing lock for
>>>> > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>>> {"id":
>>>> > >> > 1, "name": "system", "uuid>
>>>> > >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
>>>> > >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
>>>> > >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Rolling back the transaction: Time = 0 Name =
>>>> API-Job-Executor-60;
>>>> > >> called
>>>> > >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
>>>> > >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=236
>>>> > >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > allocating virtual machine from
>>>> > >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with
>>>> hostname:r-74-VM
>>>> > >> > and
>>>> > >> 12
>>>> > >> > netw>
>>>> > >> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating entries for VM: VM instance {id: "74", name:
>>>> "r-74-VM",
>>>> > uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
>>>> > >> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=249
>>>> > >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=236
>>>> > >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=240
>>>> > >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=241
>>>> > >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=242
>>>> > >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=243
>>>> > >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=244
>>>> > >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=245
>>>> > >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=246
>>>> > >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>>> > >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Service SecurityGroup is not supported in the network id=247
>>>> > >> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Allocating disks for VM instance {id: "74", name: "r-74-VM",
>>>> uuid:
>>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
>>>> > >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > adding disk object ROOT-74 to r-74-VM
>>>> > >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Rolling back the transaction: Time = 234 Name =
>>>> > >> > API-Job-Executor-60; called by
>>>> > >> > -TransactionLegacy.rollback:888-Transacti>
>>>> > >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Failed to implement network Ntwk[249|Guest|30] elements and
>>>> > >> > resources
>>>> > >> as a
>>>> > >> > part of network restart due to
>>>> > >> > java.lang.NullPointerException
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
>>>> > >> e(TemplateDataStoreVO.java:280)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
>>>> > >> rImpl.java:2009)
>>>> > >> > at
>>>> > >> >
>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>>> > >> > ive
>>>> > >> > Method)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>>> > >> MethodAccessorImpl.java:62)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>>> > >> legatingMethodAccessorImpl.java:43)
>>>> > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>>> > >> on(AopUtils.java:344)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>>> > >> inpoint(ReflectiveMethodInvocation.java:198)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > >> ReflectiveMethodInvocation.java:163)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>>> > >> e(ExposeInvocationInterceptor.java:97)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > >> ReflectiveMethodInvocation.java:186)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>>> > >> cAopProxy.java:215)
>>>> > >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>>> > >> eTemplatedVolume(VolumeOrchestrator.java:834)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>>> > >> eTemplatedVolumes(VolumeOrchestrator.java:954)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
>>>> > >> (VirtualMachineManagerImpl.java:496)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>>> > >> action(TransactionCallbackWithExceptionNoReturn.java:25)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>>> > >> action(TransactionCallbackWithExceptionNoReturn.java:21)
>>>> > >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>>> > >> Impl.java:471)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>>> > >> Impl.java:528)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
>>>> > >> s(VpcNetworkHelperImpl.java:169)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
>>>> > >> Impl.java:520)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
>>>> > >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
>>>> > >> eDeployment(RouterDeploymentDefinition.java:377)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
>>>> > >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
>>>> > >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
>>>> > >> VirtualRouter(RouterDeploymentDefinition.java:205)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
>>>> > >> lRouterElement.java:215)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>>> > >> entNetworkElements(NetworkOrchestrator.java:1488)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>>> > >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
>>>> > >> tNetwork(NetworkOrchestrator.java:3302)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>>> > >> l.java:2068)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>>> > >> l.java:2089)
>>>> > >> > at
>>>> > >> >
>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>>> > >> > ive
>>>> > >> > Method)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>>> > >> MethodAccessorImpl.java:62)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>>> > >> legatingMethodAccessorImpl.java:43)
>>>> > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>>> > >> on(AopUtils.java:344)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>>> > >> inpoint(ReflectiveMethodInvocation.java:198)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > >> ReflectiveMethodInvocation.java:163)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
>>>> > >> erceptor.invoke(EventUtils.java:107)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > >> ReflectiveMethodInvocation.java:175)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
>>>> > >> java:51)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > >> ReflectiveMethodInvocation.java:175)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>>> > >> e(ExposeInvocationInterceptor.java:97)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>>> > >> ReflectiveMethodInvocation.java:186)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>>> > >> cAopProxy.java:215)
>>>> > >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
>>>> > >> ute(RestartNetworkCmd.java:98)
>>>> > >> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
>>>> > >> :108)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
>>>> > >> Context(AsyncJobManagerImpl.java:620)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
>>>> > >> nagedContextRunnable.java:48)
>>>> > >> > at
>>>> > >> >
>>>> > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$
>>>> 1.ca
>>>> > >> ll(DefaultManagedContext.java:55)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
>>>> > >> WithContext(DefaultManagedContext.java:102)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
>>>> > >> ithContext(DefaultManagedContext.java:52)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
>>>> > >> gedContextRunnable.java:45)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
>>>> > >> syncJobManagerImpl.java:568)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
>>>> > >> rs.java:515)
>>>> > >> > at
>>>> > >> >
>>>> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
>>>> > >> lExecutor.java:1128)
>>>> > >> > at
>>>> > >> >
>>>> > >>
>>>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
>>>> > >> olExecutor.java:628)
>>>> > >> > at java.base/java.lang.Thread.run(Thread.java:829)
>>>> > >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>>> > >> (logid:6b6b9867)
>>>> > >> > Network id=249 failed to restart.
>>>> > >> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>> > >> > Complete
>>>> > >> async
>>>> > >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
>>>> > >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
>>>> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>> > >> > Publish
>>>> > >> async
>>>> > >> > job-3342 complete on message bus
>>>> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
>>>> > >> > up
>>>> > >> jobs
>>>> > >> > related to job-3342
>>>> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>>> Update
>>>> > >> > db status for job-3342
>>>> > >> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
>>>> > >> > up
>>>> > >> jobs
>>>> > >> > joined with job-3342 and disjoin all subjobs created from job-
>>>> 3342
>>>> > >> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done
>>>> > >> executing
>>>> > >> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
>>>> > >> > for
>>>> > >> > job-3342
>>>> > >> >
>>>> > >> > Regards,
>>>> > >> > Chris
>>>> > >> >
>>>> > >>
>>>> > >
>>>> >
>>>>
>>>

Re: VR for VPC won't start anymore

Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
Hi Wei,

whatever it was / is - guess i will try this.
I also found another reference for the template size in 'vm_template' -
guess i shall update this one as well manually...

Regards,
Chris

Am Fr., 5. Aug. 2022 um 13:01 Uhr schrieb Wei ZHOU <us...@gmail.com>:

> Hi,
>
> It might be because qemu-img is not installed on your management server.
>
> You can update the template.properties and database manually.
>
> -Wei
>
> On Thu, 4 Aug 2022 at 18:13, Vash_X@gmx.de <Va...@gmx.de> wrote:
>
>> Hi everyone -
>>
>> @Gary
>> thanks for your input
>>
>> @Wei ZHOU <us...@gmail.com>
>> Yes, the image is completely downloaded to the imagestore. I also checked
>> the availeabilty on the storage beneath - everything seems to be in place
>> like it should
>>
>> Following the values out ouf the db you requested:
>> id= 18
>> store_id = 1
>> download_pct = 100
>> size = "NULL"
>> store_role = Image
>> physical_size = 0
>> download_state = DOWNLOADED
>> state = READY
>> install_path =
>> /template/tmpl/1/212/0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>>
>> @Slavka
>> Following the information of the 'template.properties'
>>
>> filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>> description=SystemVM Template ( kvm )
>> hvm=false
>> size=460067328
>> qcow2=true
>> id=212
>> public=true
>> qcow2.filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
>> uniquename=routing-212
>> qcow2.virtualsize=
>> virtualsize=
>> qcow2.size=
>>
>> Regards,
>> Chris
>>
>> Am Do., 4. Aug. 2022 um 12:05 Uhr schrieb Slavka Peleva
>> <sl...@storpool.com.invalid>:
>>
>>> Hi Christopher,
>>>
>>> Can you share the information of the `template.properties` file located
>>> on
>>> your secondary storage, where the template file is downloaded? You can
>>> find
>>> the path in the template_store_ref tabled - install_path.
>>>
>>> Best regards,
>>> Slavka
>>>
>>> On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Gary.Dixon@quadris.co.uk
>>> .invalid>
>>> wrote:
>>>
>>> > Hi Christopher
>>> >
>>> > My values show :
>>> > size=2621440000 physical size=375471104 and this is for a 4.15.1
>>> systemVM
>>> > template
>>> >
>>> > BR
>>> > Gary
>>> >
>>> > Gary Dixon​
>>> > Senior Technical Consultant
>>> > T:  *0161 537 4980* <0161%20537%204980>
>>> > W: www.quadris.co.uk
>>> > The information contained in this e-mail from Quadris may be
>>> confidential
>>> > and privileged for the private use of the named recipient.  The
>>> contents of
>>> > this e-mail may not necessarily represent the official views of
>>> Quadris.
>>> > If you have received this information in error you must not copy,
>>> > distribute or take any action or reliance on its contents.  Please
>>> destroy
>>> > any hard copies and delete this message.
>>> > -----Original Message-----
>>> > From: Vash_X@gmx.de <Va...@gmx.de>
>>> > Sent: 04 August 2022 09:40
>>> > To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
>>> > Subject: Re: VR for VPC won't start anymore
>>> >
>>> > I forgot to ask - might anyone take a quick look into the database and
>>> can
>>> > give a hind if the fields are indeed "filled" with values
>>> > (template_store_res.size / template_store_res.physical_size)?
>>> > Another question for understanding would be the difference of the
>>> values -
>>> > physical size is the actual amount of data on a datasystemlevel - but
>>> what
>>> > represents the value of "size"?
>>> >
>>> > Regards,
>>> > Christopher
>>> >
>>> > Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <Vash_X@gmx.de
>>> >:
>>> >
>>> > > Wei, seems like you are heading twards the right direction - like
>>> always.
>>> > >
>>> > > i took a look into the "template_store_res" table... and guess: There
>>> > > is a entry for the current systemvmtemplate-4.16.1. How ever: The
>>> > > field for "size" ist "null" and "physical_size" is "0".
>>> > >
>>> > > Might this be the reason for the " java.lang.NullPointerException" ?
>>> > >
>>> > > Regards,
>>> > > Chris
>>> > >
>>> > > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
>>> > > <ustcweizhou@gmail.com
>>> > > >:
>>> > >
>>> > >> It looks there is no entry in template_store_ref table for the
>>> > >> systemvm template
>>> > >>
>>> > >> -Wei
>>> > >>
>>> > >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>> > >>
>>> > >> > Hi everyone,
>>> > >> >
>>> > >> > faceing currently some challanges regarding my network
>>> > >> > configuration in
>>> > >> CS
>>> > >> > 4.16.1.
>>> > >> >
>>> > >> > Setup:
>>> > >> > VPC with redundant routers and some tiers as well as an private
>>> > gateway.
>>> > >> >
>>> > >> > Today i wanted to restart the whole VPC - sadly only one vrouter
>>> > >> > "survived" .... Currently i can't depoly any networks in or
>>> outside
>>> > >> > the VPC. Also the second router shall be delployed but keeps in
>>> the
>>> > >> > stopped state.
>>> > >> > I really dont have a clue where to look at first...
>>> > >> >
>>> > >> > here the logfile from the Management-Server:
>>> > >> >
>>> > >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating the VR with id=74 in datacenter Zone {"id": "1",
>>> "name":
>>> > >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
>>> > >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Adding nic for Virtual Router in Control network
>>> > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Found existing network configuration for offering [Network
>>> Offering
>>> > >> > [3-Control-System-Control-Network]: Ntwk[202|>
>>> > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Releasing lock for
>>> > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>> {"id":
>>> > >> > 1, "name": "system", "uuid>
>>> > >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Adding nic for Virtual Router in Public network
>>> > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Found existing network configuration for offering [Network
>>> Offering
>>> > >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
>>> > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Releasing lock for
>>> > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account
>>> {"id":
>>> > >> > 1, "name": "system", "uuid>
>>> > >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
>>> > >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
>>> > >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Rolling back the transaction: Time = 0 Name = API-Job-Executor-60;
>>> > >> called
>>> > >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
>>> > >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=236
>>> > >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > allocating virtual machine from
>>> > >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with
>>> hostname:r-74-VM
>>> > >> > and
>>> > >> 12
>>> > >> > netw>
>>> > >> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating entries for VM: VM instance {id: "74", name: "r-74-VM",
>>> > uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
>>> > >> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=249
>>> > >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=236
>>> > >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=240
>>> > >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=241
>>> > >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=242
>>> > >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=243
>>> > >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=244
>>> > >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=245
>>> > >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=246
>>> > >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM",
>>> uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>>> > >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Service SecurityGroup is not supported in the network id=247
>>> > >> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Allocating disks for VM instance {id: "74", name: "r-74-VM", uuid:
>>> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
>>> > >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > adding disk object ROOT-74 to r-74-VM
>>> > >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Rolling back the transaction: Time = 234 Name =
>>> > >> > API-Job-Executor-60; called by
>>> > >> > -TransactionLegacy.rollback:888-Transacti>
>>> > >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Failed to implement network Ntwk[249|Guest|30] elements and
>>> > >> > resources
>>> > >> as a
>>> > >> > part of network restart due to
>>> > >> > java.lang.NullPointerException
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
>>> > >> e(TemplateDataStoreVO.java:280)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
>>> > >> rImpl.java:2009)
>>> > >> > at
>>> > >> >
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>> > >> > ive
>>> > >> > Method)
>>> > >> > at
>>> > >> >
>>> > >>
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>> > >> MethodAccessorImpl.java:62)
>>> > >> > at
>>> > >> >
>>> > >>
>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>> > >> legatingMethodAccessorImpl.java:43)
>>> > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>> > >> on(AopUtils.java:344)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>> > >> inpoint(ReflectiveMethodInvocation.java:198)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > >> ReflectiveMethodInvocation.java:163)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>> > >> e(ExposeInvocationInterceptor.java:97)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > >> ReflectiveMethodInvocation.java:186)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>> > >> cAopProxy.java:215)
>>> > >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>> > >> eTemplatedVolume(VolumeOrchestrator.java:834)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>>> > >> eTemplatedVolumes(VolumeOrchestrator.java:954)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
>>> > >> (VirtualMachineManagerImpl.java:496)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>> > >> action(TransactionCallbackWithExceptionNoReturn.java:25)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>>> > >> action(TransactionCallbackWithExceptionNoReturn.java:21)
>>> > >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>> > >> Impl.java:471)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>>> > >> Impl.java:528)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
>>> > >> s(VpcNetworkHelperImpl.java:169)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
>>> > >> Impl.java:520)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
>>> > >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
>>> > >> eDeployment(RouterDeploymentDefinition.java:377)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
>>> > >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
>>> > >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
>>> > >> VirtualRouter(RouterDeploymentDefinition.java:205)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
>>> > >> lRouterElement.java:215)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>> > >> entNetworkElements(NetworkOrchestrator.java:1488)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>>> > >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
>>> > >> tNetwork(NetworkOrchestrator.java:3302)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>> > >> l.java:2068)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>>> > >> l.java:2089)
>>> > >> > at
>>> > >> >
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>>> > >> > ive
>>> > >> > Method)
>>> > >> > at
>>> > >> >
>>> > >>
>>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>>> > >> MethodAccessorImpl.java:62)
>>> > >> > at
>>> > >> >
>>> > >>
>>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>>> > >> legatingMethodAccessorImpl.java:43)
>>> > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>>> > >> on(AopUtils.java:344)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>>> > >> inpoint(ReflectiveMethodInvocation.java:198)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > >> ReflectiveMethodInvocation.java:163)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
>>> > >> erceptor.invoke(EventUtils.java:107)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > >> ReflectiveMethodInvocation.java:175)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
>>> > >> java:51)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > >> ReflectiveMethodInvocation.java:175)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>>> > >> e(ExposeInvocationInterceptor.java:97)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>>> > >> ReflectiveMethodInvocation.java:186)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>>> > >> cAopProxy.java:215)
>>> > >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
>>> > >> ute(RestartNetworkCmd.java:98)
>>> > >> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>>> > >> > at
>>> > >> >
>>> > >>
>>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
>>> > >> :108)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
>>> > >> Context(AsyncJobManagerImpl.java:620)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
>>> > >> nagedContextRunnable.java:48)
>>> > >> > at
>>> > >> >
>>> > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$
>>> 1.ca
>>> > >> ll(DefaultManagedContext.java:55)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
>>> > >> WithContext(DefaultManagedContext.java:102)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
>>> > >> ithContext(DefaultManagedContext.java:52)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
>>> > >> gedContextRunnable.java:45)
>>> > >> > at
>>> > >> >
>>> > >>
>>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
>>> > >> syncJobManagerImpl.java:568)
>>> > >> > at
>>> > >> >
>>> > >>
>>> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
>>> > >> rs.java:515)
>>> > >> > at
>>> > >> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>>> > >> > at
>>> > >> >
>>> > >>
>>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
>>> > >> lExecutor.java:1128)
>>> > >> > at
>>> > >> >
>>> > >>
>>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
>>> > >> olExecutor.java:628)
>>> > >> > at java.base/java.lang.Thread.run(Thread.java:829)
>>> > >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>>> > >> (logid:6b6b9867)
>>> > >> > Network id=249 failed to restart.
>>> > >> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>> > >> > Complete
>>> > >> async
>>> > >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
>>> > >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
>>> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>> > >> > Publish
>>> > >> async
>>> > >> > job-3342 complete on message bus
>>> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
>>> > >> > up
>>> > >> jobs
>>> > >> > related to job-3342
>>> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
>>> Update
>>> > >> > db status for job-3342
>>> > >> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
>>> > >> > up
>>> > >> jobs
>>> > >> > joined with job-3342 and disjoin all subjobs created from job-
>>> 3342
>>> > >> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>>> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done
>>> > >> executing
>>> > >> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
>>> > >> > for
>>> > >> > job-3342
>>> > >> >
>>> > >> > Regards,
>>> > >> > Chris
>>> > >> >
>>> > >>
>>> > >
>>> >
>>>
>>

Re: VR for VPC won't start anymore

Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
Hi everyone -

@Gary
thanks for your input

@Wei ZHOU <us...@gmail.com>
Yes, the image is completely downloaded to the imagestore. I also checked
the availeabilty on the storage beneath - everything seems to be in place
like it should

Following the values out ouf the db you requested:
id= 18
store_id = 1
download_pct = 100
size = "NULL"
store_role = Image
physical_size = 0
download_state = DOWNLOADED
state = READY
install_path =
/template/tmpl/1/212/0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2

@Slavka
Following the information of the 'template.properties'

filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
description=SystemVM Template ( kvm )
hvm=false
size=460067328
qcow2=true
id=212
public=true
qcow2.filename=0573ec70-0a30-4e2a-be9e-4675bf755cf2.qcow2
uniquename=routing-212
qcow2.virtualsize=
virtualsize=
qcow2.size=

Regards,
Chris

Am Do., 4. Aug. 2022 um 12:05 Uhr schrieb Slavka Peleva
<sl...@storpool.com.invalid>:

> Hi Christopher,
>
> Can you share the information of the `template.properties` file located on
> your secondary storage, where the template file is downloaded? You can find
> the path in the template_store_ref tabled - install_path.
>
> Best regards,
> Slavka
>
> On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Gary.Dixon@quadris.co.uk
> .invalid>
> wrote:
>
> > Hi Christopher
> >
> > My values show :
> > size=2621440000 physical size=375471104 and this is for a 4.15.1 systemVM
> > template
> >
> > BR
> > Gary
> >
> > Gary Dixon​
> > Senior Technical Consultant
> > T:  *0161 537 4980* <0161%20537%204980>
> > W: www.quadris.co.uk
> > The information contained in this e-mail from Quadris may be confidential
> > and privileged for the private use of the named recipient.  The contents
> of
> > this e-mail may not necessarily represent the official views of Quadris.
> > If you have received this information in error you must not copy,
> > distribute or take any action or reliance on its contents.  Please
> destroy
> > any hard copies and delete this message.
> > -----Original Message-----
> > From: Vash_X@gmx.de <Va...@gmx.de>
> > Sent: 04 August 2022 09:40
> > To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
> > Subject: Re: VR for VPC won't start anymore
> >
> > I forgot to ask - might anyone take a quick look into the database and
> can
> > give a hind if the fields are indeed "filled" with values
> > (template_store_res.size / template_store_res.physical_size)?
> > Another question for understanding would be the difference of the values
> -
> > physical size is the actual amount of data on a datasystemlevel - but
> what
> > represents the value of "size"?
> >
> > Regards,
> > Christopher
> >
> > Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:
> >
> > > Wei, seems like you are heading twards the right direction - like
> always.
> > >
> > > i took a look into the "template_store_res" table... and guess: There
> > > is a entry for the current systemvmtemplate-4.16.1. How ever: The
> > > field for "size" ist "null" and "physical_size" is "0".
> > >
> > > Might this be the reason for the " java.lang.NullPointerException" ?
> > >
> > > Regards,
> > > Chris
> > >
> > > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
> > > <ustcweizhou@gmail.com
> > > >:
> > >
> > >> It looks there is no entry in template_store_ref table for the
> > >> systemvm template
> > >>
> > >> -Wei
> > >>
> > >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
> > >>
> > >> > Hi everyone,
> > >> >
> > >> > faceing currently some challanges regarding my network
> > >> > configuration in
> > >> CS
> > >> > 4.16.1.
> > >> >
> > >> > Setup:
> > >> > VPC with redundant routers and some tiers as well as an private
> > gateway.
> > >> >
> > >> > Today i wanted to restart the whole VPC - sadly only one vrouter
> > >> > "survived" .... Currently i can't depoly any networks in or outside
> > >> > the VPC. Also the second router shall be delployed but keeps in the
> > >> > stopped state.
> > >> > I really dont have a clue where to look at first...
> > >> >
> > >> > here the logfile from the Management-Server:
> > >> >
> > >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating the VR with id=74 in datacenter Zone {"id": "1", "name":
> > >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
> > >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Adding nic for Virtual Router in Control network
> > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Found existing network configuration for offering [Network Offering
> > >> > [3-Control-System-Control-Network]: Ntwk[202|>
> > >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Releasing lock for
> > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account {"id":
> > >> > 1, "name": "system", "uuid>
> > >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Adding nic for Virtual Router in Public network
> > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Found existing network configuration for offering [Network Offering
> > >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
> > >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Releasing lock for
> > >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account {"id":
> > >> > 1, "name": "system", "uuid>
> > >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
> > >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
> > >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Rolling back the transaction: Time = 0 Name = API-Job-Executor-60;
> > >> called
> > >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
> > >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=236
> > >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > allocating virtual machine from
> > >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with hostname:r-74-VM
> > >> > and
> > >> 12
> > >> > netw>
> > >> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating entries for VM: VM instance {id: "74", name: "r-74-VM",
> > uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
> > >> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=249
> > >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=236
> > >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=240
> > >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=241
> > >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=242
> > >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=243
> > >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=244
> > >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=245
> > >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=246
> > >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Service SecurityGroup is not supported in the network id=247
> > >> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Allocating disks for VM instance {id: "74", name: "r-74-VM", uuid:
> > >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
> > >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > adding disk object ROOT-74 to r-74-VM
> > >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Rolling back the transaction: Time = 234 Name =
> > >> > API-Job-Executor-60; called by
> > >> > -TransactionLegacy.rollback:888-Transacti>
> > >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Failed to implement network Ntwk[249|Guest|30] elements and
> > >> > resources
> > >> as a
> > >> > part of network restart due to
> > >> > java.lang.NullPointerException
> > >> > at
> > >> >
> > >> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
> > >> e(TemplateDataStoreVO.java:280)
> > >> > at
> > >> >
> > >> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
> > >> rImpl.java:2009)
> > >> > at
> > >> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
> > >> > ive
> > >> > Method)
> > >> > at
> > >> >
> > >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
> > >> MethodAccessorImpl.java:62)
> > >> > at
> > >> >
> > >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
> > >> legatingMethodAccessorImpl.java:43)
> > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> > >> > at
> > >> >
> > >> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
> > >> on(AopUtils.java:344)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
> > >> inpoint(ReflectiveMethodInvocation.java:198)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > >> ReflectiveMethodInvocation.java:163)
> > >> > at
> > >> >
> > >> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
> > >> e(ExposeInvocationInterceptor.java:97)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > >> ReflectiveMethodInvocation.java:186)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
> > >> cAopProxy.java:215)
> > >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
> > >> eTemplatedVolume(VolumeOrchestrator.java:834)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
> > >> eTemplatedVolumes(VolumeOrchestrator.java:954)
> > >> > at
> > >> >
> > >> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
> > >> (VirtualMachineManagerImpl.java:496)
> > >> > at
> > >> >
> > >> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
> > >> action(TransactionCallbackWithExceptionNoReturn.java:25)
> > >> > at
> > >> >
> > >> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
> > >> action(TransactionCallbackWithExceptionNoReturn.java:21)
> > >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
> > >> > at
> > >> >
> > >> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
> > >> Impl.java:471)
> > >> > at
> > >> >
> > >> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
> > >> Impl.java:528)
> > >> > at
> > >> >
> > >> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
> > >> s(VpcNetworkHelperImpl.java:169)
> > >> > at
> > >> >
> > >> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
> > >> Impl.java:520)
> > >> > at
> > >> >
> > >> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
> > >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
> > >> > at
> > >> >
> > >> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
> > >> eDeployment(RouterDeploymentDefinition.java:377)
> > >> > at
> > >> >
> > >> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
> > >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
> > >> > at
> > >> >
> > >> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
> > >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
> > >> > at
> > >> >
> > >> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
> > >> VirtualRouter(RouterDeploymentDefinition.java:205)
> > >> > at
> > >> >
> > >> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
> > >> lRouterElement.java:215)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
> > >> entNetworkElements(NetworkOrchestrator.java:1488)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
> > >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
> > >> tNetwork(NetworkOrchestrator.java:3302)
> > >> > at
> > >> >
> > >> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
> > >> l.java:2068)
> > >> > at
> > >> >
> > >> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
> > >> l.java:2089)
> > >> > at
> > >> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
> > >> > ive
> > >> > Method)
> > >> > at
> > >> >
> > >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
> > >> MethodAccessorImpl.java:62)
> > >> > at
> > >> >
> > >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
> > >> legatingMethodAccessorImpl.java:43)
> > >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> > >> > at
> > >> >
> > >> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
> > >> on(AopUtils.java:344)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
> > >> inpoint(ReflectiveMethodInvocation.java:198)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > >> ReflectiveMethodInvocation.java:163)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
> > >> erceptor.invoke(EventUtils.java:107)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > >> ReflectiveMethodInvocation.java:175)
> > >> > at
> > >> >
> > >> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
> > >> java:51)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > >> ReflectiveMethodInvocation.java:175)
> > >> > at
> > >> >
> > >> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
> > >> e(ExposeInvocationInterceptor.java:97)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> > >> ReflectiveMethodInvocation.java:186)
> > >> > at
> > >> >
> > >> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
> > >> cAopProxy.java:215)
> > >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
> > >> ute(RestartNetworkCmd.java:98)
> > >> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
> > >> > at
> > >> >
> > >> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
> > >> :108)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
> > >> Context(AsyncJobManagerImpl.java:620)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
> > >> nagedContextRunnable.java:48)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca
> > >> ll(DefaultManagedContext.java:55)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
> > >> WithContext(DefaultManagedContext.java:102)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
> > >> ithContext(DefaultManagedContext.java:52)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
> > >> gedContextRunnable.java:45)
> > >> > at
> > >> >
> > >> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
> > >> syncJobManagerImpl.java:568)
> > >> > at
> > >> >
> > >> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
> > >> rs.java:515)
> > >> > at
> > >> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> > >> > at
> > >> >
> > >> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
> > >> lExecutor.java:1128)
> > >> > at
> > >> >
> > >> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
> > >> olExecutor.java:628)
> > >> > at java.base/java.lang.Thread.run(Thread.java:829)
> > >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> > >> (logid:6b6b9867)
> > >> > Network id=249 failed to restart.
> > >> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
> > >> > Complete
> > >> async
> > >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
> > >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
> > >> > Publish
> > >> async
> > >> > job-3342 complete on message bus
> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
> > >> > up
> > >> jobs
> > >> > related to job-3342
> > >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Update
> > >> > db status for job-3342
> > >> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
> > >> > up
> > >> jobs
> > >> > joined with job-3342 and disjoin all subjobs created from job- 3342
> > >> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done
> > >> executing
> > >> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
> > >> > for
> > >> > job-3342
> > >> >
> > >> > Regards,
> > >> > Chris
> > >> >
> > >>
> > >
> >
>

Re: VR for VPC won't start anymore

Posted by Slavka Peleva <sl...@storpool.com.INVALID>.
Hi Christopher,

Can you share the information of the `template.properties` file located on
your secondary storage, where the template file is downloaded? You can find
the path in the template_store_ref tabled - install_path.

Best regards,
Slavka

On Thu, Aug 4, 2022 at 12:41 PM Gary Dixon <Ga...@quadris.co.uk.invalid>
wrote:

> Hi Christopher
>
> My values show :
> size=2621440000 physical size=375471104 and this is for a 4.15.1 systemVM
> template
>
> BR
> Gary
>
> Gary Dixon​
> Senior Technical Consultant
> T:  *0161 537 4980* <0161%20537%204980>
> W: www.quadris.co.uk
> The information contained in this e-mail from Quadris may be confidential
> and privileged for the private use of the named recipient.  The contents of
> this e-mail may not necessarily represent the official views of Quadris.
> If you have received this information in error you must not copy,
> distribute or take any action or reliance on its contents.  Please destroy
> any hard copies and delete this message.
> -----Original Message-----
> From: Vash_X@gmx.de <Va...@gmx.de>
> Sent: 04 August 2022 09:40
> To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
> Subject: Re: VR for VPC won't start anymore
>
> I forgot to ask - might anyone take a quick look into the database and can
> give a hind if the fields are indeed "filled" with values
> (template_store_res.size / template_store_res.physical_size)?
> Another question for understanding would be the difference of the values -
> physical size is the actual amount of data on a datasystemlevel - but what
> represents the value of "size"?
>
> Regards,
> Christopher
>
> Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:
>
> > Wei, seems like you are heading twards the right direction - like always.
> >
> > i took a look into the "template_store_res" table... and guess: There
> > is a entry for the current systemvmtemplate-4.16.1. How ever: The
> > field for "size" ist "null" and "physical_size" is "0".
> >
> > Might this be the reason for the " java.lang.NullPointerException" ?
> >
> > Regards,
> > Chris
> >
> > Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU
> > <ustcweizhou@gmail.com
> > >:
> >
> >> It looks there is no entry in template_store_ref table for the
> >> systemvm template
> >>
> >> -Wei
> >>
> >> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
> >>
> >> > Hi everyone,
> >> >
> >> > faceing currently some challanges regarding my network
> >> > configuration in
> >> CS
> >> > 4.16.1.
> >> >
> >> > Setup:
> >> > VPC with redundant routers and some tiers as well as an private
> gateway.
> >> >
> >> > Today i wanted to restart the whole VPC - sadly only one vrouter
> >> > "survived" .... Currently i can't depoly any networks in or outside
> >> > the VPC. Also the second router shall be delployed but keeps in the
> >> > stopped state.
> >> > I really dont have a clue where to look at first...
> >> >
> >> > here the logfile from the Management-Server:
> >> >
> >> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating the VR with id=74 in datacenter Zone {"id": "1", "name":
> >> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
> >> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Adding nic for Virtual Router in Control network
> >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Found existing network configuration for offering [Network Offering
> >> > [3-Control-System-Control-Network]: Ntwk[202|>
> >> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Releasing lock for
> >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account {"id":
> >> > 1, "name": "system", "uuid>
> >> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Adding nic for Virtual Router in Public network
> >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Found existing network configuration for offering [Network Offering
> >> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
> >> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Releasing lock for
> >> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account {"id":
> >> > 1, "name": "system", "uuid>
> >> > 2022-08-03 20:35:48,793 INFO [c.c.n.r.NetworkHelperImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
> >> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
> >> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Rolling back the transaction: Time = 0 Name = API-Job-Executor-60;
> >> called
> >> > by -TransactionLegacy.rollback:888-PrivateIpDa>
> >> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=236
> >> > 2022-08-03 20:35:48,851 INFO [c.c.v.VirtualMachineManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > allocating virtual machine from
> >> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with hostname:r-74-VM
> >> > and
> >> 12
> >> > netw>
> >> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating entries for VM: VM instance {id: "74", name: "r-74-VM",
> uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
> >> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=249
> >> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=236
> >> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=240
> >> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=241
> >> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=242
> >> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=243
> >> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=244
> >> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=245
> >> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=246
> >> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> >> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Service SecurityGroup is not supported in the network id=247
> >> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Allocating disks for VM instance {id: "74", name: "r-74-VM", uuid:
> >> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
> >> > 2022-08-03 20:35:49,088 INFO [o.a.c.e.o.VolumeOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > adding disk object ROOT-74 to r-74-VM
> >> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Rolling back the transaction: Time = 234 Name =
> >> > API-Job-Executor-60; called by
> >> > -TransactionLegacy.rollback:888-Transacti>
> >> > 2022-08-03 20:35:49,099 WARN [o.a.c.e.o.NetworkOrchestrator]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Failed to implement network Ntwk[249|Guest|30] elements and
> >> > resources
> >> as a
> >> > part of network restart due to
> >> > java.lang.NullPointerException
> >> > at
> >> >
> >> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
> >> e(TemplateDataStoreVO.java:280)
> >> > at
> >> >
> >> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
> >> rImpl.java:2009)
> >> > at
> >> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
> >> > ive
> >> > Method)
> >> > at
> >> >
> >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
> >> MethodAccessorImpl.java:62)
> >> > at
> >> >
> >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
> >> legatingMethodAccessorImpl.java:43)
> >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> >> > at
> >> >
> >> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
> >> on(AopUtils.java:344)
> >> > at
> >> >
> >> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
> >> inpoint(ReflectiveMethodInvocation.java:198)
> >> > at
> >> >
> >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> >> ReflectiveMethodInvocation.java:163)
> >> > at
> >> >
> >> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
> >> e(ExposeInvocationInterceptor.java:97)
> >> > at
> >> >
> >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> >> ReflectiveMethodInvocation.java:186)
> >> > at
> >> >
> >> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
> >> cAopProxy.java:215)
> >> > at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
> >> > at
> >> >
> >> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
> >> eTemplatedVolume(VolumeOrchestrator.java:834)
> >> > at
> >> >
> >> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
> >> eTemplatedVolumes(VolumeOrchestrator.java:954)
> >> > at
> >> >
> >> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
> >> (VirtualMachineManagerImpl.java:496)
> >> > at
> >> >
> >> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
> >> action(TransactionCallbackWithExceptionNoReturn.java:25)
> >> > at
> >> >
> >> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
> >> action(TransactionCallbackWithExceptionNoReturn.java:21)
> >> > at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
> >> > at
> >> >
> >> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
> >> Impl.java:471)
> >> > at
> >> >
> >> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
> >> Impl.java:528)
> >> > at
> >> >
> >> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
> >> s(VpcNetworkHelperImpl.java:169)
> >> > at
> >> >
> >> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
> >> Impl.java:520)
> >> > at
> >> >
> >> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
> >> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
> >> > at
> >> >
> >> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
> >> eDeployment(RouterDeploymentDefinition.java:377)
> >> > at
> >> >
> >> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
> >> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
> >> > at
> >> >
> >> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
> >> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
> >> > at
> >> >
> >> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
> >> VirtualRouter(RouterDeploymentDefinition.java:205)
> >> > at
> >> >
> >> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
> >> lRouterElement.java:215)
> >> > at
> >> >
> >> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
> >> entNetworkElements(NetworkOrchestrator.java:1488)
> >> > at
> >> >
> >> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
> >> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
> >> > at
> >> >
> >> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
> >> tNetwork(NetworkOrchestrator.java:3302)
> >> > at
> >> >
> >> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
> >> l.java:2068)
> >> > at
> >> >
> >> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
> >> l.java:2089)
> >> > at
> >> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
> >> > ive
> >> > Method)
> >> > at
> >> >
> >> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
> >> MethodAccessorImpl.java:62)
> >> > at
> >> >
> >> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
> >> legatingMethodAccessorImpl.java:43)
> >> > at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> >> > at
> >> >
> >> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
> >> on(AopUtils.java:344)
> >> > at
> >> >
> >> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
> >> inpoint(ReflectiveMethodInvocation.java:198)
> >> > at
> >> >
> >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> >> ReflectiveMethodInvocation.java:163)
> >> > at
> >> >
> >> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
> >> erceptor.invoke(EventUtils.java:107)
> >> > at
> >> >
> >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> >> ReflectiveMethodInvocation.java:175)
> >> > at
> >> >
> >> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
> >> java:51)
> >> > at
> >> >
> >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> >> ReflectiveMethodInvocation.java:175)
> >> > at
> >> >
> >> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
> >> e(ExposeInvocationInterceptor.java:97)
> >> > at
> >> >
> >> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
> >> ReflectiveMethodInvocation.java:186)
> >> > at
> >> >
> >> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
> >> cAopProxy.java:215)
> >> > at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
> >> > at
> >> >
> >> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
> >> ute(RestartNetworkCmd.java:98)
> >> > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
> >> > at
> >> >
> >> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
> >> :108)
> >> > at
> >> >
> >> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
> >> Context(AsyncJobManagerImpl.java:620)
> >> > at
> >> >
> >> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
> >> nagedContextRunnable.java:48)
> >> > at
> >> >
> >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca
> >> ll(DefaultManagedContext.java:55)
> >> > at
> >> >
> >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
> >> WithContext(DefaultManagedContext.java:102)
> >> > at
> >> >
> >> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
> >> ithContext(DefaultManagedContext.java:52)
> >> > at
> >> >
> >> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
> >> gedContextRunnable.java:45)
> >> > at
> >> >
> >> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
> >> syncJobManagerImpl.java:568)
> >> > at
> >> >
> >> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
> >> rs.java:515)
> >> > at
> >> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> >> > at
> >> >
> >> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
> >> lExecutor.java:1128)
> >> > at
> >> >
> >> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
> >> olExecutor.java:628)
> >> > at java.base/java.lang.Thread.run(Thread.java:829)
> >> > 2022-08-03 20:35:49,100 WARN [c.c.n.NetworkServiceImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
> >> (logid:6b6b9867)
> >> > Network id=249 failed to restart.
> >> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
> >> > Complete
> >> async
> >> > job-3342, jobStatus: FAILED, resultCode: 530, result:
> >> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
> >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867)
> >> > Publish
> >> async
> >> > job-3342 complete on message bus
> >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
> >> > up
> >> jobs
> >> > related to job-3342
> >> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Update
> >> > db status for job-3342
> >> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake
> >> > up
> >> jobs
> >> > joined with job-3342 and disjoin all subjobs created from job- 3342
> >> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> >> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done
> >> executing
> >> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
> >> > for
> >> > job-3342
> >> >
> >> > Regards,
> >> > Chris
> >> >
> >>
> >
>

RE: VR for VPC won't start anymore

Posted by Gary Dixon <Ga...@quadris.co.uk.INVALID>.
Hi Christopher

My values show :
size=2621440000 physical size=375471104 and this is for a 4.15.1 systemVM template

BR 
Gary


Gary Dixon
Senior Technical Consultant
T:  0161 537 4980
W: www.quadris.co.uk
The information contained in this e-mail from Quadris may be confidential and privileged for the private use of the named recipient.  The contents of this e-mail may not necessarily represent the official views of Quadris.  If you have received this information in error you must not copy, distribute or take any action or reliance on its contents.  Please destroy any hard copies and delete this message.
-----Original Message-----
From: Vash_X@gmx.de <Va...@gmx.de> 
Sent: 04 August 2022 09:40
To: users@cloudstack.apache.org; Wei ZHOU <us...@gmail.com>
Subject: Re: VR for VPC won't start anymore

I forgot to ask - might anyone take a quick look into the database and can give a hind if the fields are indeed "filled" with values (template_store_res.size / template_store_res.physical_size)?
Another question for understanding would be the difference of the values - physical size is the actual amount of data on a datasystemlevel - but what represents the value of "size"?

Regards,
Christopher

Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:

> Wei, seems like you are heading twards the right direction - like always.
>
> i took a look into the "template_store_res" table... and guess: There 
> is a entry for the current systemvmtemplate-4.16.1. How ever: The 
> field for "size" ist "null" and "physical_size" is "0".
>
> Might this be the reason for the " java.lang.NullPointerException" ?
>
> Regards,
> Chris
>
> Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU 
> <ustcweizhou@gmail.com
> >:
>
>> It looks there is no entry in template_store_ref table for the 
>> systemvm template
>>
>> -Wei
>>
>> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>
>> > Hi everyone,
>> >
>> > faceing currently some challanges regarding my network 
>> > configuration in
>> CS
>> > 4.16.1.
>> >
>> > Setup:
>> > VPC with redundant routers and some tiers as well as an private gateway.
>> >
>> > Today i wanted to restart the whole VPC - sadly only one vrouter 
>> > "survived" .... Currently i can't depoly any networks in or outside 
>> > the VPC. Also the second router shall be delployed but keeps in the 
>> > stopped state.
>> > I really dont have a clue where to look at first...
>> >
>> > here the  logfile from the Management-Server:
>> >
>> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating the VR with id=74 in datacenter Zone {"id": "1", "name":
>> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
>> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Adding nic for Virtual Router in Control network
>> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Found existing network configuration for offering [Network Offering
>> > [3-Control-System-Control-Network]: Ntwk[202|>
>> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Releasing lock for 
>> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account {"id": 
>> > 1, "name": "system", "uuid>
>> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Adding nic for Virtual Router in Public network
>> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Found existing network configuration for offering [Network Offering
>> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
>> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Releasing lock for 
>> > Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] -- Account {"id": 
>> > 1, "name": "system", "uuid>
>> > 2022-08-03 20:35:48,793 INFO  [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
>> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
>> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Rolling back the transaction: Time = 0 Name =  API-Job-Executor-60;
>> called
>> > by -TransactionLegacy.rollback:888-PrivateIpDa>
>> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=236
>> > 2022-08-03 20:35:48,851 INFO  [c.c.v.VirtualMachineManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > allocating virtual machine from
>> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with hostname:r-74-VM 
>> > and
>> 12
>> > netw>
>> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating entries for VM: VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
>> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=249
>> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=236
>> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=240
>> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=241
>> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=242
>> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=243
>> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=244
>> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=245
>> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=246
>> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=247
>> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating disks for VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
>> > 2022-08-03 20:35:49,088 INFO  [o.a.c.e.o.VolumeOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > adding disk object ROOT-74 to r-74-VM
>> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Rolling back the transaction: Time = 234 Name =  
>> > API-Job-Executor-60; called by 
>> > -TransactionLegacy.rollback:888-Transacti>
>> > 2022-08-03 20:35:49,099 WARN  [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Failed to implement network Ntwk[249|Guest|30] elements and 
>> > resources
>> as a
>> > part of network restart due to
>> > java.lang.NullPointerException
>> >         at
>> >
>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSiz
>> e(TemplateDataStoreVO.java:280)
>> >         at
>> >
>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManage
>> rImpl.java:2009)
>> >         at
>> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>> > ive
>> > Method)
>> >         at
>> >
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>> MethodAccessorImpl.java:62)
>> >         at
>> >
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>> legatingMethodAccessorImpl.java:43)
>> >         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>> >         at
>> >
>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>> on(AopUtils.java:344)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>> inpoint(ReflectiveMethodInvocation.java:198)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> ReflectiveMethodInvocation.java:163)
>> >         at
>> >
>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>> e(ExposeInvocationInterceptor.java:97)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> ReflectiveMethodInvocation.java:186)
>> >         at
>> >
>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>> cAopProxy.java:215)
>> >         at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>> eTemplatedVolume(VolumeOrchestrator.java:834)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocat
>> eTemplatedVolumes(VolumeOrchestrator.java:954)
>> >         at
>> >
>> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult
>> (VirtualMachineManagerImpl.java:496)
>> >         at
>> >
>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>> action(TransactionCallbackWithExceptionNoReturn.java:25)
>> >         at
>> >
>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTrans
>> action(TransactionCallbackWithExceptionNoReturn.java:21)
>> >         at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>> >         at
>> >
>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>> Impl.java:471)
>> >         at
>> >
>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManager
>> Impl.java:528)
>> >         at
>> >
>> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetwork
>> s(VpcNetworkHelperImpl.java:169)
>> >         at
>> >
>> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelper
>> Impl.java:520)
>> >         at
>> >
>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.dep
>> loyAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>> >         at
>> >
>> org.cloud.network.router.deployment.RouterDeploymentDefinition.execut
>> eDeployment(RouterDeploymentDefinition.java:377)
>> >         at
>> >
>> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOr
>> DeployVirtualRouter(RouterDeploymentDefinition.java:239)
>> >         at
>> >
>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.fin
>> dOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>> >         at
>> >
>> org.cloud.network.router.deployment.RouterDeploymentDefinition.deploy
>> VirtualRouter(RouterDeploymentDefinition.java:205)
>> >         at
>> >
>> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtua
>> lRouterElement.java:215)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>> entNetworkElements(NetworkOrchestrator.java:1488)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implem
>> entNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restar
>> tNetwork(NetworkOrchestrator.java:3302)
>> >         at
>> >
>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>> l.java:2068)
>> >         at
>> >
>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImp
>> l.java:2089)
>> >         at
>> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Nat
>> > ive
>> > Method)
>> >         at
>> >
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(Native
>> MethodAccessorImpl.java:62)
>> >         at
>> >
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(De
>> legatingMethodAccessorImpl.java:43)
>> >         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>> >         at
>> >
>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflecti
>> on(AopUtils.java:344)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJo
>> inpoint(ReflectiveMethodInvocation.java:198)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> ReflectiveMethodInvocation.java:163)
>> >         at
>> >
>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInt
>> erceptor.invoke(EventUtils.java:107)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> ReflectiveMethodInvocation.java:175)
>> >         at
>> >
>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.
>> java:51)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> ReflectiveMethodInvocation.java:175)
>> >         at
>> >
>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invok
>> e(ExposeInvocationInterceptor.java:97)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(
>> ReflectiveMethodInvocation.java:186)
>> >         at
>> >
>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynami
>> cAopProxy.java:215)
>> >         at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>> >         at
>> >
>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.exec
>> ute(RestartNetworkCmd.java:98)
>> >         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>> >         at
>> >
>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java
>> :108)
>> >         at
>> >
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runIn
>> Context(AsyncJobManagerImpl.java:620)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(Ma
>> nagedContextRunnable.java:48)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.ca
>> ll(DefaultManagedContext.java:55)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.call
>> WithContext(DefaultManagedContext.java:102)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runW
>> ithContext(DefaultManagedContext.java:52)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(Mana
>> gedContextRunnable.java:45)
>> >         at
>> >
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(A
>> syncJobManagerImpl.java:568)
>> >         at
>> >
>> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executo
>> rs.java:515)
>> >         at
>> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>> >         at
>> >
>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoo
>> lExecutor.java:1128)
>> >         at
>> >
>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPo
>> olExecutor.java:628)
>> >         at java.base/java.lang.Thread.run(Thread.java:829)
>> > 2022-08-03 20:35:49,100 WARN  [c.c.n.NetworkServiceImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Network id=249 failed to restart.
>> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) 
>> > Complete
>> async
>> > job-3342, jobStatus: FAILED, resultCode: 530, result:
>> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
>> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) 
>> > Publish
>> async
>> > job-3342 complete on message bus
>> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake 
>> > up
>> jobs
>> > related to job-3342
>> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Update 
>> > db status for job-3342
>> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake 
>> > up
>> jobs
>> > joined with job-3342 and disjoin all subjobs created from job- 3342
>> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done
>> executing
>> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd 
>> > for
>> > job-3342
>> >
>> > Regards,
>> > Chris
>> >
>>
>

Re: VR for VPC won't start anymore

Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
I forgot to ask - might anyone take a quick look into the database and can
give a hind if the fields are indeed "filled" with values
(template_store_res.size / template_store_res.physical_size)?
Another question for understanding would be the difference of the values -
physical size is the actual amount of data on a datasystemlevel - but what
represents the value of "size"?

Regards,
Christopher

Am Mi., 3. Aug. 2022 um 23:14 Uhr schrieb Vash_X@gmx.de <Va...@gmx.de>:

> Wei, seems like you are heading twards the right direction - like always.
>
> i took a look into the "template_store_res" table... and guess: There is a
> entry for the current systemvmtemplate-4.16.1. How ever: The field for
> "size" ist "null" and "physical_size" is "0".
>
> Might this be the reason for the " java.lang.NullPointerException" ?
>
> Regards,
> Chris
>
> Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU <ustcweizhou@gmail.com
> >:
>
>> It looks there is no entry in template_store_ref table for the systemvm
>> template
>>
>> -Wei
>>
>> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
>>
>> > Hi everyone,
>> >
>> > faceing currently some challanges regarding my network configuration in
>> CS
>> > 4.16.1.
>> >
>> > Setup:
>> > VPC with redundant routers and some tiers as well as an private gateway.
>> >
>> > Today i wanted to restart the whole VPC - sadly only one vrouter
>> > "survived" .... Currently i can't depoly any networks in or outside the
>> > VPC. Also the second router shall be delployed but keeps in the stopped
>> > state.
>> > I really dont have a clue where to look at first...
>> >
>> > here the  logfile from the Management-Server:
>> >
>> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating the VR with id=74 in datacenter Zone {"id": "1", "name":
>> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
>> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Adding nic for Virtual Router in Control network
>> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Found existing network configuration for offering [Network Offering
>> > [3-Control-System-Control-Network]: Ntwk[202|>
>> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Releasing lock for Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] --
>> > Account {"id": 1, "name": "system", "uuid>
>> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Adding nic for Virtual Router in Public network
>> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Found existing network configuration for offering [Network Offering
>> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
>> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Releasing lock for Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] --
>> > Account {"id": 1, "name": "system", "uuid>
>> > 2022-08-03 20:35:48,793 INFO  [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
>> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
>> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Rolling back the transaction: Time = 0 Name =  API-Job-Executor-60;
>> called
>> > by -TransactionLegacy.rollback:888-PrivateIpDa>
>> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=236
>> > 2022-08-03 20:35:48,851 INFO  [c.c.v.VirtualMachineManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > allocating virtual machine from
>> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with hostname:r-74-VM and
>> 12
>> > netw>
>> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating entries for VM: VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
>> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=249
>> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=236
>> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=240
>> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=241
>> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=242
>> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=243
>> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=244
>> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=245
>> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=246
>> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
>> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Service SecurityGroup is not supported in the network id=247
>> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Allocating disks for VM instance {id: "74", name: "r-74-VM", uuid:
>> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
>> > 2022-08-03 20:35:49,088 INFO  [o.a.c.e.o.VolumeOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > adding disk object ROOT-74 to r-74-VM
>> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Rolling back the transaction: Time = 234 Name =  API-Job-Executor-60;
>> > called by -TransactionLegacy.rollback:888-Transacti>
>> > 2022-08-03 20:35:49,099 WARN  [o.a.c.e.o.NetworkOrchestrator]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Failed to implement network Ntwk[249|Guest|30] elements and resources
>> as a
>> > part of network restart due to
>> > java.lang.NullPointerException
>> >         at
>> >
>> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSize(TemplateDataStoreVO.java:280)
>> >         at
>> >
>> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManagerImpl.java:2009)
>> >         at
>> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
>> > Method)
>> >         at
>> >
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> >         at
>> >
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>> >         at
>> >
>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
>> >         at
>> >
>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
>> >         at
>> >
>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
>> >         at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocateTemplatedVolume(VolumeOrchestrator.java:834)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocateTemplatedVolumes(VolumeOrchestrator.java:954)
>> >         at
>> >
>> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult(VirtualMachineManagerImpl.java:496)
>> >         at
>> >
>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:25)
>> >         at
>> >
>> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:21)
>> >         at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>> >         at
>> >
>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManagerImpl.java:471)
>> >         at
>> >
>> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManagerImpl.java:528)
>> >         at
>> >
>> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetworks(VpcNetworkHelperImpl.java:169)
>> >         at
>> >
>> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelperImpl.java:520)
>> >         at
>> >
>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.deployAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>> >         at
>> >
>> org.cloud.network.router.deployment.RouterDeploymentDefinition.executeDeployment(RouterDeploymentDefinition.java:377)
>> >         at
>> >
>> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOrDeployVirtualRouter(RouterDeploymentDefinition.java:239)
>> >         at
>> >
>> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.findOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>> >         at
>> >
>> org.cloud.network.router.deployment.RouterDeploymentDefinition.deployVirtualRouter(RouterDeploymentDefinition.java:205)
>> >         at
>> >
>> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtualRouterElement.java:215)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElements(NetworkOrchestrator.java:1488)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>> >         at
>> >
>> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restartNetwork(NetworkOrchestrator.java:3302)
>> >         at
>> >
>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:2068)
>> >         at
>> >
>> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:2089)
>> >         at
>> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
>> > Method)
>> >         at
>> >
>> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>> >         at
>> >
>> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> >         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>> >         at
>> >
>> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
>> >         at
>> >
>> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
>> >         at
>> >
>> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
>> >         at
>> >
>> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
>> >         at
>> >
>> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
>> >         at
>> >
>> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
>> >         at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>> >         at
>> >
>> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.execute(RestartNetworkCmd.java:98)
>> >         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>> >         at
>> >
>> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
>> >         at
>> >
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:620)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
>> >         at
>> >
>> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45)
>> >         at
>> >
>> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:568)
>> >         at
>> >
>> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
>> >         at
>> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>> >         at
>> >
>> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
>> >         at
>> >
>> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
>> >         at java.base/java.lang.Thread.run(Thread.java:829)
>> > 2022-08-03 20:35:49,100 WARN  [c.c.n.NetworkServiceImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2)
>> (logid:6b6b9867)
>> > Network id=249 failed to restart.
>> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Complete
>> async
>> > job-3342, jobStatus: FAILED, resultCode: 530, result:
>> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
>> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Publish
>> async
>> > job-3342 complete on message bus
>> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake up
>> jobs
>> > related to job-3342
>> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Update db
>> > status for job-3342
>> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake up
>> jobs
>> > joined with job-3342 and disjoin all subjobs created from job- 3342
>> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
>> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done
>> executing
>> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd for
>> > job-3342
>> >
>> > Regards,
>> > Chris
>> >
>>
>

Re: VR for VPC won't start anymore

Posted by "Vash_X@gmx.de" <Va...@gmx.de>.
Wei, seems like you are heading twards the right direction - like always.

i took a look into the "template_store_res" table... and guess: There is a
entry for the current systemvmtemplate-4.16.1. How ever: The field for
"size" ist "null" and "physical_size" is "0".

Might this be the reason for the " java.lang.NullPointerException" ?

Regards,
Chris

Am Mi., 3. Aug. 2022 um 21:56 Uhr schrieb Wei ZHOU <us...@gmail.com>:

> It looks there is no entry in template_store_ref table for the systemvm
> template
>
> -Wei
>
> On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:
>
> > Hi everyone,
> >
> > faceing currently some challanges regarding my network configuration in
> CS
> > 4.16.1.
> >
> > Setup:
> > VPC with redundant routers and some tiers as well as an private gateway.
> >
> > Today i wanted to restart the whole VPC - sadly only one vrouter
> > "survived" .... Currently i can't depoly any networks in or outside the
> > VPC. Also the second router shall be delployed but keeps in the stopped
> > state.
> > I really dont have a clue where to look at first...
> >
> > here the  logfile from the Management-Server:
> >
> > 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating the VR with id=74 in datacenter Zone {"id": "1", "name":
> > "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
> > 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Adding nic for Virtual Router in Control network
> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Found existing network configuration for offering [Network Offering
> > [3-Control-System-Control-Network]: Ntwk[202|>
> > 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Releasing lock for Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] --
> > Account {"id": 1, "name": "system", "uuid>
> > 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Adding nic for Virtual Router in Public network
> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Found existing network configuration for offering [Network Offering
> > [1-Public-System-Public-Network]: Ntwk[200|Pu>
> > 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Releasing lock for Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] --
> > Account {"id": 1, "name": "system", "uuid>
> > 2022-08-03 20:35:48,793 INFO  [c.c.n.r.NetworkHelperImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
> > 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
> > 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Rolling back the transaction: Time = 0 Name =  API-Job-Executor-60;
> called
> > by -TransactionLegacy.rollback:888-PrivateIpDa>
> > 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=236
> > 2022-08-03 20:35:48,851 INFO  [c.c.v.VirtualMachineManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > allocating virtual machine from
> > template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with hostname:r-74-VM and
> 12
> > netw>
> > 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating entries for VM: VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3">
> > 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=249
> > 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=236
> > 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=240
> > 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=241
> > 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=242
> > 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=243
> > 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=244
> > 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=245
> > 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=246
> > 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> > 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Service SecurityGroup is not supported in the network id=247
> > 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Allocating disks for VM instance {id: "74", name: "r-74-VM", uuid:
> > "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
> > 2022-08-03 20:35:49,088 INFO  [o.a.c.e.o.VolumeOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > adding disk object ROOT-74 to r-74-VM
> > 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Rolling back the transaction: Time = 234 Name =  API-Job-Executor-60;
> > called by -TransactionLegacy.rollback:888-Transacti>
> > 2022-08-03 20:35:49,099 WARN  [o.a.c.e.o.NetworkOrchestrator]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Failed to implement network Ntwk[249|Guest|30] elements and resources as
> a
> > part of network restart due to
> > java.lang.NullPointerException
> >         at
> >
> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSize(TemplateDataStoreVO.java:280)
> >         at
> >
> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManagerImpl.java:2009)
> >         at
> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Method)
> >         at
> >
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >         at
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> >         at
> >
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
> >         at
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
> >         at
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
> >         at
> >
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
> >         at
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
> >         at
> >
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
> >         at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
> >         at
> >
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocateTemplatedVolume(VolumeOrchestrator.java:834)
> >         at
> >
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocateTemplatedVolumes(VolumeOrchestrator.java:954)
> >         at
> >
> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult(VirtualMachineManagerImpl.java:496)
> >         at
> >
> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:25)
> >         at
> >
> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:21)
> >         at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
> >         at
> >
> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManagerImpl.java:471)
> >         at
> >
> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManagerImpl.java:528)
> >         at
> >
> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetworks(VpcNetworkHelperImpl.java:169)
> >         at
> >
> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelperImpl.java:520)
> >         at
> >
> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.deployAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
> >         at
> >
> org.cloud.network.router.deployment.RouterDeploymentDefinition.executeDeployment(RouterDeploymentDefinition.java:377)
> >         at
> >
> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOrDeployVirtualRouter(RouterDeploymentDefinition.java:239)
> >         at
> >
> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.findOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
> >         at
> >
> org.cloud.network.router.deployment.RouterDeploymentDefinition.deployVirtualRouter(RouterDeploymentDefinition.java:205)
> >         at
> >
> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtualRouterElement.java:215)
> >         at
> >
> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElements(NetworkOrchestrator.java:1488)
> >         at
> >
> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElementsAndResources(NetworkOrchestrator.java:1423)
> >         at
> >
> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restartNetwork(NetworkOrchestrator.java:3302)
> >         at
> >
> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:2068)
> >         at
> >
> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:2089)
> >         at
> > java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> > Method)
> >         at
> >
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >         at
> >
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
> >         at
> >
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
> >         at
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
> >         at
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
> >         at
> >
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
> >         at
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
> >         at
> >
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
> >         at
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
> >         at
> >
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
> >         at
> >
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
> >         at
> >
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
> >         at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
> >         at
> >
> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.execute(RestartNetworkCmd.java:98)
> >         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
> >         at
> >
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
> >         at
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:620)
> >         at
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48)
> >         at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
> >         at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
> >         at
> >
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
> >         at
> >
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45)
> >         at
> >
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:568)
> >         at
> >
> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
> >         at
> > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
> >         at
> >
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
> >         at
> >
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
> >         at java.base/java.lang.Thread.run(Thread.java:829)
> > 2022-08-03 20:35:49,100 WARN  [c.c.n.NetworkServiceImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> > Network id=249 failed to restart.
> > 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Complete
> async
> > job-3342, jobStatus: FAILED, resultCode: 530, result:
> > org.apache.cloudstack.api.response.ExceptionResponse/nu>
> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Publish
> async
> > job-3342 complete on message bus
> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake up jobs
> > related to job-3342
> > 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Update db
> > status for job-3342
> > 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake up jobs
> > joined with job-3342 and disjoin all subjobs created from job- 3342
> > 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> > (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done
> executing
> > org.apache.cloudstack.api.command.user.network.RestartNetworkCmd for
> > job-3342
> >
> > Regards,
> > Chris
> >
>

Re: VR for VPC won't start anymore

Posted by Wei ZHOU <us...@gmail.com>.
It looks there is no entry in template_store_ref table for the systemvm
template

-Wei

On Wed, 3 Aug 2022 at 21:43, Vash_X@gmx.de <Va...@gmx.de> wrote:

> Hi everyone,
>
> faceing currently some challanges regarding my network configuration in CS
> 4.16.1.
>
> Setup:
> VPC with redundant routers and some tiers as well as an private gateway.
>
> Today i wanted to restart the whole VPC - sadly only one vrouter
> "survived" .... Currently i can't depoly any networks in or outside the
> VPC. Also the second router shall be delployed but keeps in the stopped
> state.
> I really dont have a clue where to look at first...
>
> here the  logfile from the Management-Server:
>
> 2022-08-03 20:35:48,768 DEBUG [c.c.n.r.NetworkHelperImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating the VR with id=74 in datacenter Zone {"id": "1", "name":
> "xxxxxxxxxx", "uuid": "48e2e928-3300-43b5-8e3a-d>
> 2022-08-03 20:35:48,776 DEBUG [c.c.n.r.NetworkHelperImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Adding nic for Virtual Router in Control network
> 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Found existing network configuration for offering [Network Offering
> [3-Control-System-Control-Network]: Ntwk[202|>
> 2022-08-03 20:35:48,781 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Releasing lock for Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] --
> Account {"id": 1, "name": "system", "uuid>
> 2022-08-03 20:35:48,785 DEBUG [c.c.n.r.NetworkHelperImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Adding nic for Virtual Router in Public network
> 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Found existing network configuration for offering [Network Offering
> [1-Public-System-Public-Network]: Ntwk[200|Pu>
> 2022-08-03 20:35:48,789 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Releasing lock for Acct[60bddbd5-1d8a-11ec-83ce-525400c9c662-system] --
> Account {"id": 1, "name": "system", "uuid>
> 2022-08-03 20:35:48,793 INFO  [c.c.n.r.NetworkHelperImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Use same MAC as previous RvR, the MAC is 1e:00:59:00:00:b2
> 2022-08-03 20:35:48,793 DEBUG [c.c.n.r.NetworkHelperImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Adding nic for Virtual Router in Guest network Ntwk[249|Guest|30]
> 2022-08-03 20:35:48,801 DEBUG [c.c.u.d.T.Transaction]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Rolling back the transaction: Time = 0 Name =  API-Job-Executor-60; called
> by -TransactionLegacy.rollback:888-PrivateIpDa>
> 2022-08-03 20:35:48,808 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=236
> 2022-08-03 20:35:48,851 INFO  [c.c.v.VirtualMachineManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> allocating virtual machine from
> template:0573ec70-0a30-4e2a-be9e-4675bf755cf2 with hostname:r-74-VM and 12
> netw>
> 2022-08-03 20:35:48,852 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating entries for VM: VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3">
> 2022-08-03 20:35:48,857 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nics for VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:48,858 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:48,866 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:48,886 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:48,904 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=249
> 2022-08-03 20:35:48,907 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:48,917 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=236
> 2022-08-03 20:35:48,920 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:48,939 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=240
> 2022-08-03 20:35:48,942 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:48,959 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=241
> 2022-08-03 20:35:48,962 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:48,985 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=242
> 2022-08-03 20:35:48,987 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:49,004 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=243
> 2022-08-03 20:35:49,008 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:49,026 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=244
> 2022-08-03 20:35:49,029 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:49,046 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=245
> 2022-08-03 20:35:49,049 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:49,065 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=246
> 2022-08-03 20:35:49,068 DEBUG [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating nic for vm VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type=>
> 2022-08-03 20:35:49,085 DEBUG [c.c.n.NetworkModelImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Service SecurityGroup is not supported in the network id=247
> 2022-08-03 20:35:49,088 DEBUG [c.c.v.VirtualMachineManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Allocating disks for VM instance {id: "74", name: "r-74-VM", uuid:
> "09dc644b-76a2-404a-82fd-aecc8d5799c3", type>
> 2022-08-03 20:35:49,088 INFO  [o.a.c.e.o.VolumeOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> adding disk object ROOT-74 to r-74-VM
> 2022-08-03 20:35:49,091 DEBUG [c.c.u.d.T.Transaction]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Rolling back the transaction: Time = 234 Name =  API-Job-Executor-60;
> called by -TransactionLegacy.rollback:888-Transacti>
> 2022-08-03 20:35:49,099 WARN  [o.a.c.e.o.NetworkOrchestrator]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Failed to implement network Ntwk[249|Guest|30] elements and resources as a
> part of network restart due to
> java.lang.NullPointerException
>         at
> org.apache.cloudstack.storage.datastore.db.TemplateDataStoreVO.getSize(TemplateDataStoreVO.java:280)
>         at
> com.cloud.template.TemplateManagerImpl.getTemplateSize(TemplateManagerImpl.java:2009)
>         at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>         at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>         at
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
>         at
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
>         at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
>         at
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
>         at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
>         at
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
>         at com.sun.proxy.$Proxy201.getTemplateSize(Unknown Source)
>         at
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocateTemplatedVolume(VolumeOrchestrator.java:834)
>         at
> org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.allocateTemplatedVolumes(VolumeOrchestrator.java:954)
>         at
> com.cloud.vm.VirtualMachineManagerImpl$1.doInTransactionWithoutResult(VirtualMachineManagerImpl.java:496)
>         at
> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:25)
>         at
> com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:21)
>         at com.cloud.utils.db.Transaction.execute(Transaction.java:40)
>         at
> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManagerImpl.java:471)
>         at
> com.cloud.vm.VirtualMachineManagerImpl.allocate(VirtualMachineManagerImpl.java:528)
>         at
> com.cloud.network.router.VpcNetworkHelperImpl.reallocateRouterNetworks(VpcNetworkHelperImpl.java:169)
>         at
> com.cloud.network.router.NetworkHelperImpl.deployRouter(NetworkHelperImpl.java:520)
>         at
> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.deployAllVirtualRouters(VpcRouterDeploymentDefinition.java:178)
>         at
> org.cloud.network.router.deployment.RouterDeploymentDefinition.executeDeployment(RouterDeploymentDefinition.java:377)
>         at
> org.cloud.network.router.deployment.RouterDeploymentDefinition.findOrDeployVirtualRouter(RouterDeploymentDefinition.java:239)
>         at
> org.cloud.network.router.deployment.VpcRouterDeploymentDefinition.findOrDeployVirtualRouter(VpcRouterDeploymentDefinition.java:140)
>         at
> org.cloud.network.router.deployment.RouterDeploymentDefinition.deployVirtualRouter(RouterDeploymentDefinition.java:205)
>         at
> com.cloud.network.element.VpcVirtualRouterElement.implement(VpcVirtualRouterElement.java:215)
>         at
> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElements(NetworkOrchestrator.java:1488)
>         at
> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.implementNetworkElementsAndResources(NetworkOrchestrator.java:1423)
>         at
> org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.restartNetwork(NetworkOrchestrator.java:3302)
>         at
> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:2068)
>         at
> com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:2089)
>         at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native
> Method)
>         at
> java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.base/java.lang.reflect.Method.invoke(Method.java:566)
>         at
> org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)
>         at
> org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)
>         at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
>         at
> org.apache.cloudstack.network.contrail.management.EventUtils$EventInterceptor.invoke(EventUtils.java:107)
>         at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
>         at
> com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:51)
>         at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)
>         at
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
>         at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
>         at
> org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)
>         at com.sun.proxy.$Proxy168.restartNetwork(Unknown Source)
>         at
> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd.execute(RestartNetworkCmd.java:98)
>         at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156)
>         at
> com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108)
>         at
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:620)
>         at
> org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:48)
>         at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:55)
>         at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:102)
>         at
> org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:52)
>         at
> org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:45)
>         at
> org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:568)
>         at
> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
>         at
> java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
>         at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
>         at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
>         at java.base/java.lang.Thread.run(Thread.java:829)
> 2022-08-03 20:35:49,100 WARN  [c.c.n.NetworkServiceImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342 ctx-150e61a2) (logid:6b6b9867)
> Network id=249 failed to restart.
> 2022-08-03 20:35:49,111 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Complete async
> job-3342, jobStatus: FAILED, resultCode: 530, result:
> org.apache.cloudstack.api.response.ExceptionResponse/nu>
> 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Publish async
> job-3342 complete on message bus
> 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake up jobs
> related to job-3342
> 2022-08-03 20:35:49,112 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Update db
> status for job-3342
> 2022-08-03 20:35:49,114 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Wake up jobs
> joined with job-3342 and disjoin all subjobs created from job- 3342
> 2022-08-03 20:35:49,119 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
> (API-Job-Executor-60:ctx-a9f63190 job-3342) (logid:6b6b9867) Done executing
> org.apache.cloudstack.api.command.user.network.RestartNetworkCmd for
> job-3342
>
> Regards,
> Chris
>