You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "Parth Jagirdar (JIRA)" <ji...@apache.org> on 2014/02/03 21:55:06 UTC
[jira] [Commented] (CLOUDSTACK-6016) MS: MS out of memory
java.lang.OutOfMemoryError: PermGen space
[ https://issues.apache.org/jira/browse/CLOUDSTACK-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13889912#comment-13889912 ]
Parth Jagirdar commented on CLOUDSTACK-6016:
--------------------------------------------
[root@localhost mnt]# service cloudstack-management restart
Stopping cloudstack-management: [FAILED]
Starting cloudstack-management: [ OK ]
Log continues to throw OOM after stopping the service.
> MS: MS out of memory java.lang.OutOfMemoryError: PermGen space
> --------------------------------------------------------------
>
> Key: CLOUDSTACK-6016
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6016
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the default.)
> Components: Contrail, Management Server, XenServer
> Affects Versions: 4.2.1
> Environment: Master with Contrail and Xen.
> Reporter: Parth Jagirdar
> Priority: Critical
> Fix For: 4.2.1
>
> Attachments: management-server_attachment.log.bz2
>
>
> Detailed logs are attached ..
> +----+---------+--------------------------------------+-------------------+------+----------------+--------+------------+---------------+----------------+----------------+-----------+--------------------------------------------------------+---------------------+---------+-------------+--------+-----------------------+---------+------------+---------+---------------+
> | id | name | uuid | pool_type | port | data_center_id | pod_id | cluster_id | used_bytes | capacity_bytes | host_address | user_info | path | created | removed | update_time | status | storage_provider_name | scope | hypervisor | managed | capacity_iops |
> +----+---------+--------------------------------------+-------------------+------+----------------+--------+------------+---------------+----------------+----------------+-----------+--------------------------------------------------------+---------------------+---------+-------------+--------+-----------------------+---------+------------+---------+---------------+
> | 16 | primary | 15027b8a-bb16-3f01-b5af-e980a0060f25 | NetworkFilesystem | 2049 | 1 | 1 | 1 | 4029850058752 | 11810778316800 | 10.223.110.232 | NULL | /export/home/parth/contrail/cloudstack_248_196/primary | 2014-01-31 20:53:34 | NULL | NULL | Up | DefaultPrimary | CLUSTER | NULL | 0 | NULL |
> +----+---------+--------------------------------------+-------------------+------+----------------+--------+------------+---------------+----------------+----------------+-----------+--------------------------------------------------------+---------------------+---------+-------------+--------+-----------------------+---------+------------+---------+---------------+
> 1 row in set (0.01 sec)
> mysql> select * from storage_pool_view;
> +----+--------------------------------------+---------+--------+--------------------------------------------------------+-------------------+----------------+---------------------+---------+----------------+---------------+---------+------------+-----------------------+------------+--------------------------------------+----------------+--------------+----------------+--------------------------------------+------------------+------------------+--------+--------------------------------------+-----------+------+--------------------+------------------------+--------+----------+------------+----------------+
> | id | uuid | name | status | path | pool_type | host_address | created | removed | capacity_bytes | capacity_iops | scope | hypervisor | storage_provider_name | cluster_id | cluster_uuid | cluster_name | cluster_type | data_center_id | data_center_uuid | data_center_name | data_center_type | pod_id | pod_uuid | pod_name | tag | disk_used_capacity | disk_reserved_capacity | job_id | job_uuid | job_status | job_account_id |
> +----+--------------------------------------+---------+--------+--------------------------------------------------------+-------------------+----------------+---------------------+---------+----------------+---------------+---------+------------+-----------------------+------------+--------------------------------------+----------------+--------------+----------------+--------------------------------------+------------------+------------------+--------+--------------------------------------+-----------+------+--------------------+------------------------+--------+----------+------------+----------------+
> | 16 | 15027b8a-bb16-3f01-b5af-e980a0060f25 | primary | Up | /export/home/parth/contrail/cloudstack_248_196/primary | NetworkFilesystem | 10.223.110.232 | 2014-01-31 20:53:34 | NULL | 11810778316800 | NULL | CLUSTER | NULL | DefaultPrimary | 1 | 878b925d-9373-4dc5-88f2-9a83d6d924b2 | demo-pod2-xen1 | CloudManaged | 1 | 8d2fe185-7f85-45e0-b523-cf318c66e799 | default | Advanced | 1 | fdd9ed6b-3618-4f9f-afe1-191eb290da22 | demo-pod2 | NULL | 0 | 0 | NULL | NULL | NULL | NULL |
> +----+--------------------------------------+---------+--------+--------------------------------------------------------+-------------------+----------------+---------------------+---------+----------------+---------------+---------+------------+-----------------------+------------+--------------------------------------+----------------+--------------+----------------+--------------------------------------+------------------+------------------+--------+--------------------------------------+-----------+------+--------------------+------------------------+--------+----------+------------+----------------+
> 1 row in set (0.00 sec)
> 2014-02-02 14:22:33,377 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl] (secstorage-1:ctx-61d52c4c) template 1
> is already in store:16, type:Primary
> 2014-02-02 14:22:33,379 DEBUG [o.a.c.s.v.VolumeServiceImpl] (secstorage-1:ctx-61d52c4c) Found template ro
> uting-1 in storage pool 16 with VMTemplateStoragePool id: 11868
> 2014-02-02 14:22:37,360 INFO [o.a.c.s.v.VolumeServiceImpl] (consoleproxy-1:ctx-c605fca1) Unable to acqui
> re lock on VMTemplateStoragePool 11867
> 2014-02-02 14:22:49,487 DEBUG [c.c.s.StatsCollector] (StatsCollector-2:ctx-b70366de) VmStatsCollector is
> running...
> 2014-02-02 14:24:09,967 DEBUG [c.c.s.StatsCollector] (StatsCollector-1:ctx-f7f09a60) HostStatsCollector i
> s running...
> 2014-02-02 14:24:09,966 DEBUG [c.c.s.StatsCollector] (StatsCollector-3:ctx-0ec2cf0e) StorageCollector is
> running...
> 2014-02-02 14:24:09,966 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-7:ctx-350f3bc0) Seq 2-760414210:
> Executing request
> 2014-02-02 14:23:58,075 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-333:ctx-b500c0a9) Seq 1-100250419
> 4: Executing request
> 2014-02-02 14:23:58,075 DEBUG [c.c.c.ClusterManagerImpl] (Cluster-Heartbeat-1:ctx-3763fe2a) Management se
> rver heartbeat takes too long to finish. profiler: Done. Duration: 75297ms, profilerHeartbeatUpdate: Done
> . Duration: 7251ms, profilerPeerScan: Started but not stopped
> 2014-02-02 14:24:34,629 DEBUG [c.c.v.VirtualMachineManagerImpl] (secstorage-1:ctx-61d52c4c) Cleaning up r
> esources for the vm VM[SecondaryStorageVm|s-2968-VM] in Starting state
> 2014-02-02 14:24:34,629 DEBUG [c.c.v.VirtualMachineManagerImpl] (consoleproxy-1:ctx-c605fca1) Cleaning up
> resources for the vm VM[ConsoleProxy|v-2-VM] in Starting state
> 2014-02-02 14:24:34,887 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-61d52c4c) Seq 1-1002523328: Sending {
> Cmd , MgmtId: 214076393326387, via: 1(xenserver-2), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopCo
> mmand":{"isProxy":false,"executeInSequence":false,"vmName":"s-2968-VM","wait":0}}] }
> 2014-02-02 14:24:34,887 DEBUG [c.c.a.t.Request] (secstorage-1:ctx-61d52c4c) Seq 1-1002523328: Executing:
> { Cmd , MgmtId: 214076393326387, via: 1(xenserver-2), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.Sto
> pCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-2968-VM","wait":0}}] }
> 2014-02-02 14:24:39,397 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-c605fca1) Seq 2-760433604: Sending {
> Cmd , MgmtId: 214076393326387, via: 2(xenserver-1), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.StopC
> ommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-2-VM","wait":0}}] }
> 2014-02-02 14:24:39,397 DEBUG [c.c.a.t.Request] (consoleproxy-1:ctx-c605fca1) Seq 2-760433604: Executing:
> { Cmd , MgmtId: 214076393326387, via: 2(xenserver-1), Ver: v1, Flags: 100011, [{"com.cloud.agent.api.St
> opCommand":{"isProxy":false,"executeInSequence":false,"vmName":"v-2-VM","wait":0}}] }
> 2014-02-02 14:24:39,414 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-b0e
> c7c97) Found 0 routers to update status.
> 2014-02-02 14:24:47,366 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-153:ctx-bd2d4c7f) Seq 1-100252332
> 8: Executing request
> 2014-02-02 14:24:47,366 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-275:ctx-d43e2414) Seq 2-760433604
> : Executing request
> 2014-02-02 14:24:51,658 ERROR [c.c.s.StatsCollector] (StatsCollector-3:ctx-0ec2cf0e) Error trying to retr
> ieve storage stats
> java.lang.OutOfMemoryError: PermGen space
> 2014-02-02 14:24:59,201 ERROR [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-4ca44bf9) Unexpected exception when trying to execute queue item,
> java.lang.OutOfMemoryError: PermGen space
> 2014-02-02 14:24:59,215 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-7:ctx-350f3bc0) Seq 2-760414210: Response Received:
> 2014-02-02 14:24:59,215 DEBUG [c.c.a.t.Request] (DirectAgent-7:ctx-350f3bc0) Seq 2-760414210: Processing: { Ans: , MgmtId: 214076393326387, via: 2, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] }
> 2014-02-02 14:24:59,216 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-7:ctx-de693d5b) Seq 2-760414210: Executing request
> 2014-02-02 14:25:11,353 ERROR [c.c.s.StatsCollector] (StatsCollector-1:ctx-f7f09a60) Error trying to retrieve host stats
> java.lang.OutOfMemoryError: PermGen space
> 2014-02-02 14:25:39,109 DEBUG [o.a.c.n.c.m.ContrailManager] (DBSyncTimer:null) DB Sync task is running
> 2014-02-02 14:25:39,109 DEBUG [o.a.c.n.c.m.ServerDBSync] (DBSyncTimer:null) syncing cloudstack db with v
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)