You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Sateesh Chodapuneedi (JIRA)" <ji...@apache.org> on 2014/01/03 09:43:53 UTC

[jira] [Comment Edited] (CLOUDSTACK-5408) [Automation] Failed to deploy vm in vmware environment with error "due to java.io.IOException: Cannot run program "mount": java.io.IOException: error=12, Cannot allocate memory"

    [ https://issues.apache.org/jira/browse/CLOUDSTACK-5408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13861343#comment-13861343 ] 

Sateesh Chodapuneedi edited comment on CLOUDSTACK-5408 at 1/3/14 8:42 AM:
--------------------------------------------------------------------------

Increased swap space inside SSVM to 256MB. This has helped. Now snapshot operation on volume was successful.

root@s-12-VM:~# free -m
             total       used       free     shared    buffers     cached
Mem:           241        238          3          0          0          9
-/+ buffers/cache:        228         13
Swap:          255        192         63

2014-01-03 07:22:34,663 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) volss: copy vmdk and ovf file finishes 1388733754663
2014-01-03 07:22:34,664 INFO  [vmware.mo.HttpNfcLeaseMO] (agentRequest-Handler-1:null) close ProgressReporter, interrupt reporter runner to let it quit
2014-01-03 07:22:34,664 INFO  [vmware.mo.HttpNfcLeaseMO] (Thread-3:null) ProgressReporter is interrupted, quiting
2014-01-03 07:22:34,764 INFO  [vmware.mo.HttpNfcLeaseMO] (Thread-3:null) ProgressReporter stopped
2014-01-03 07:23:10,095 INFO  [storage.resource.VmwareStorageProcessor] (agentRequest-Handler-1:null) Check if we have disk consolidation after snapshot operation
2014-01-03 07:23:10,096 INFO  [storage.resource.VmwareStorageProcessor] (agentRequest-Handler-1:null) Validate disk chain file:[7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk
2014-01-03 07:23:10,110 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Look for disk device info from volume : [7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk
2014-01-03 07:23:10,111 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk device, controller key: 200, unit number: 1
2014-01-03 07:23:10,111 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk backing : [20cd70ee163932ecaedf8541162dc393] i-2-9-VM/ROOT-9.vmdk
2014-01-03 07:23:10,112 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk backing : [20cd70ee163932ecaedf8541162dc393] 286ac1c57c9f3f8a8d2089f6e9d6452c/286ac1c57c9f3f8a8d2089f6ed6452c.vmdk
2014-01-03 07:23:10,113 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk device, controller key: 1000, unit number: 0
2014-01-03 07:23:10,113 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk backing : [7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk
2014-01-03 07:23:10,113 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Disk backing : [7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk matches ==> scsi0:0
2014-01-03 07:23:10,114 INFO  [storage.resource.VmwareStorageProcessor] (agentRequest-Handler-1:null) [7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk is found still in chain
2014-01-03 07:23:10,155 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Seq 6-866189338:  { Ans: , MgmtId: 227080256212965, via: 6, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnwer":{"newData":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/2/15/c6d4811f-fccb-4345-a1b2-607af05254c4/c6d4811f-fccb-4345-a1b2-607af05254c4","id":0,"quiescevm":false}},"result":true,"ait":0}}] }



was (Author: sateeshc):
Increased swap space to 256MB. This has helped. Now snapshot operation on volume was successful.

root@s-12-VM:~# free -m
             total       used       free     shared    buffers     cached
Mem:           241        238          3          0          0          9
-/+ buffers/cache:        228         13
Swap:          255        192         63

2014-01-03 07:22:34,663 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) volss: copy vmdk and ovf file finishes 1388733754663
2014-01-03 07:22:34,664 INFO  [vmware.mo.HttpNfcLeaseMO] (agentRequest-Handler-1:null) close ProgressReporter, interrupt reporter runner to let it quit
2014-01-03 07:22:34,664 INFO  [vmware.mo.HttpNfcLeaseMO] (Thread-3:null) ProgressReporter is interrupted, quiting
2014-01-03 07:22:34,764 INFO  [vmware.mo.HttpNfcLeaseMO] (Thread-3:null) ProgressReporter stopped
2014-01-03 07:23:10,095 INFO  [storage.resource.VmwareStorageProcessor] (agentRequest-Handler-1:null) Check if we have disk consolidation after snapshot operation
2014-01-03 07:23:10,096 INFO  [storage.resource.VmwareStorageProcessor] (agentRequest-Handler-1:null) Validate disk chain file:[7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk
2014-01-03 07:23:10,110 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Look for disk device info from volume : [7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk
2014-01-03 07:23:10,111 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk device, controller key: 200, unit number: 1
2014-01-03 07:23:10,111 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk backing : [20cd70ee163932ecaedf8541162dc393] i-2-9-VM/ROOT-9.vmdk
2014-01-03 07:23:10,112 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk backing : [20cd70ee163932ecaedf8541162dc393] 286ac1c57c9f3f8a8d2089f6e9d6452c/286ac1c57c9f3f8a8d2089f6ed6452c.vmdk
2014-01-03 07:23:10,113 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk device, controller key: 1000, unit number: 0
2014-01-03 07:23:10,113 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Test against disk backing : [7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk
2014-01-03 07:23:10,113 INFO  [vmware.mo.VirtualMachineMO] (agentRequest-Handler-1:null) Disk backing : [7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk matches ==> scsi0:0
2014-01-03 07:23:10,114 INFO  [storage.resource.VmwareStorageProcessor] (agentRequest-Handler-1:null) [7b2ba866ca873954a935a354f3889574] i-2-9-VM/419e86326c6e400487228ffb1e7ec805.vmdk is found still in chain
2014-01-03 07:23:10,155 DEBUG [cloud.agent.Agent] (agentRequest-Handler-1:null) Seq 6-866189338:  { Ans: , MgmtId: 227080256212965, via: 6, Ver: v1, Flags: 10, [{"org.apache.cloudstack.storage.command.CopyCmdAnwer":{"newData":{"org.apache.cloudstack.storage.to.SnapshotObjectTO":{"path":"snapshots/2/15/c6d4811f-fccb-4345-a1b2-607af05254c4/c6d4811f-fccb-4345-a1b2-607af05254c4","id":0,"quiescevm":false}},"result":true,"ait":0}}] }


> [Automation] Failed to deploy vm in vmware environment with error "due to java.io.IOException: Cannot run program "mount": java.io.IOException: error=12, Cannot allocate memory" 
> ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CLOUDSTACK-5408
>                 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5408
>             Project: CloudStack
>          Issue Type: Bug
>      Security Level: Public(Anyone can view this level - this is the default.) 
>          Components: VMware
>    Affects Versions: 4.3.0
>         Environment: vmware 5.0 update 3
> 64 bit template 
>            Reporter: Rayees Namathponnan
>            Assignee: Sateesh Chodapuneedi
>            Priority: Critical
>             Fix For: 4.3.0
>
>         Attachments: CLOUDSTACK-5408.rar
>
>
> Steps to reproduce 
> Create advanced zone in vmware
> use 64 bit template 
> deploy VM
> Result
> SSVM are crated
> Routers are created 
> VM deployment failed with below error 
> yStorageResource.mountUri(NfsSecondaryStorageResource.java:2293)\n\tat org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.getRootDir(NfsSecondaryStorageResource.java:1934)\n\tat com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.getMountPoint(VmwareSecondaryStorageResourceHandler.java:311)\n\tat com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateFromSecondaryToPrimary(VmwareStorageProcessor.java:131)\n\tat com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateToPrimaryStorage(VmwareStorageProcessor.java:221)\n\tat com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)\n\tat com.cloud.storage.resource.VmwareStorageSubsystemCommandHandler.execute(VmwareStorageSubsystemCommandHandler.java:155)\n\tat com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)\n\tat com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.executeRequest(VmwareSecondaryStorageResourceHandler.java:101)\n\tat com.cloud.storage.resource.PremiumSecondaryStorageResource.executeRequest(PremiumSecondaryStorageResource.java:56)\n\tat com.cloud.agent.Agent.processRequest(Agent.java:498)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)\n\tat com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat java.lang.Thread.run(Thread.java:679)\nCaused by: java.io.IOException: java.io.IOException: error=12, Cannot allocate memory\n\tat java.lang.UNIXProcess.<init>(UNIXProcess.java:164)\n\tat java.lang.ProcessImpl.start(ProcessImpl.java:81)\n\tat java.lang.ProcessBuilder.start(ProcessBuilder.java:470)\n\t... 20 more\n\n","wait":0}}] }
> 2013-12-07 14:07:59,776 DEBUG [c.c.a.t.Request] (Job-Executor-23:ctx-f22d6e84 ctx-b6c94672) Seq 5-137756744: Received:  { Ans: , MgmtId: 90928106758026, via: 5, Ver: v1, Flags: 10, { CopyCmdAnswer } }
> 2013-12-07 14:07:59,791 INFO  [o.a.c.s.v.VolumeServiceImpl] (Job-Executor-23:ctx-f22d6e84 ctx-b6c94672) releasing lock for VMTemplateStoragePool 9
> 2013-12-07 14:07:59,791 WARN  [c.c.u.d.Merovingian2] (Job-Executor-23:ctx-f22d6e84 ctx-b6c94672) Was unable to find lock for the key template_spool_ref9 and thread id 1402045270
> 2013-12-07 14:07:59,791 DEBUG [o.a.c.e.o.VolumeOrchestrator] (Job-Executor-23:ctx-f22d6e84 ctx-b6c94672) Unable to create Vol[8|vm=8|ROOT]:Unable to copy template to primary storage due to exception:Exception: com.cloud.utils.exception.CloudRuntimeException
> Message: GetRootDir for nfs://10.223.240.164:/home/common/automation/SC-CLOUD-QA03/secondary1 failed due to com.cloud.utils.exception.CloudRuntimeException: Unable to mount 10.223.240.164:/home/common/automation/SC-CLOUD-QA03/secondary1 at /mnt/SecStorage/c6ec0966-00ab-3817-8a96-e8f4c3e03269 due to java.io.IOException: Cannot run program "mount": java.io.IOException: error=12, Cannot allocate memory
>         at java.lang.ProcessBuilder.start(ProcessBuilder.java:488)
>         at com.cloud.utils.script.Script.execute(Script.java:177)
>         at com.cloud.utils.script.Script.execute(Script.java:155)
>         at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.attemptMount(NfsSecondaryStorageResource.java:2374)
>         at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.mount(NfsSecondaryStorageResource.java:2331)
>         at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.mountUri(NfsSecondaryStorageResource.java:2293)
>         at org.apache.cloudstack.storage.resource.NfsSecondaryStorageResource.getRootDir(NfsSecondaryStorageResource.java:1934)
>         at com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.getMountPoint(VmwareSecondaryStorageResourceHandler.java:311)
>         at com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateFromSecondaryToPrimary(VmwareStorageProcessor.java:131)
>         at com.cloud.storage.resource.VmwareStorageProcessor.copyTemplateToPrimaryStorage(VmwareStorageProcessor.java:221)
>         at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:75)
>         at com.cloud.storage.resource.VmwareStorageSubsystemCommandHandler.execute(VmwareStorageSubsystemCommandHandler.java:155)
>         at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:50)
>         at com.cloud.storage.resource.VmwareSecondaryStorageResourceHandler.executeRequest(VmwareSecondaryStorageResourceHandler.java:101)
>         at com.cloud.storage.resource.PremiumSecondaryStorageResource.executeRequest(PremiumSecondaryStorageResource.java:56)
>         at com.cloud.agent.Agent.processRequest(Agent.java:498)
>         at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:806)
>         at com.cloud.utils.nio.Task.run(Task.java:83)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>         at java.lang.Thread.run(Thread.java:679)
> Caused by: java.io.IOException: java.io.IOException: error=12, Cannot allocate memory
>         at java.lang.UNIXProcess.<init>(UNIXProcess.java:164)
>         at java.lang.ProcessImpl.start(ProcessImpl.java:81)
>         at java.lang.ProcessBuilder.start(ProcessBuilder.java:470)
>         ... 20 more



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)