You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@cloudstack.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2013/06/10 15:01:21 UTC
[jira] [Commented] (CLOUDSTACK-2707) Usage server creates entries
very slow for mysql performance degradation
[ https://issues.apache.org/jira/browse/CLOUDSTACK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679483#comment-13679483 ]
ASF subversion and git services commented on CLOUDSTACK-2707:
-------------------------------------------------------------
Commit 76ce304411259dc4a29e0e070de829b79b46efe2 in branch refs/heads/master from [~weizhou]
[ https://git-wip-us.apache.org/repos/asf?p=cloudstack.git;h=76ce304 ]
CLOUDSTACK-2707: use executeBatch instead of persist in Usage Server
> Usage server creates entries very slow for mysql performance degradation
> ------------------------------------------------------------------------
>
> Key: CLOUDSTACK-2707
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2707
> Project: CloudStack
> Issue Type: Improvement
> Security Level: Public(Anyone can view this level - this is the default.)
> Reporter: Wei Zhou
> Assignee: Wei Zhou
>
> As we know, the insert performance into a mysql table degrades when the records of table reaches 1,000,000. It takes more time and more CPU utilization.
> Here is log in usage.log
> 2013-05-27 09:13:24,827 INFO [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) starting usage job...
> 2013-05-27 09:13:24,829 INFO [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) Parsing usage records between Mon May 27 11:10:05 CEST 2013 and Mon May 27 11:13:24 CEST 2013
> 2013-05-27 09:13:25,534 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 1252; abs: 847
> 2013-05-27 09:13:25,534 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 1252; abs: 847; curABS: 847; curABR: 1252; ubs: 0; ubr: 0
> 2013-05-27 09:13:26,467 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 16112; abs: 16112
> 2013-05-27 09:13:26,468 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 16112; abs: 16112; curABS: 16112; curABR: 16112; ubs: 0; ubr: 0
> 2013-05-27 09:13:28,220 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 0; abs: 0
> 2013-05-27 09:13:28,220 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 0; abs: 0; curABS: 0; curABR: 0; ubs: 0; ubr: 0
> 2013-05-27 09:13:29,266 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 3648; abs: 3648
> 2013-05-27 09:13:29,266 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 3648; abs: 3648; curABS: 3648; curABR: 3648; ubs: 0; ubr: 0
> 2013-05-27 09:13:30,339 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 32984; abs: 32984
> 2013-05-27 09:13:30,339 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 32984; abs: 32984; curABS: 32984; curABR: 32984; ubs: 0; ubr: 0
> 2013-05-27 09:13:31,830 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 118636; abs: 118940
> ......
> 2013-05-27 09:16:08,285 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) getting current accounted bytes for... accountId: 2 in zone: 1; abr: 0; abs: 0
> 2013-05-27 09:16:08,285 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) creating networkHelperEntry... accountId: 2 in zone: 1; abr: 0; abs: 0; curABS: 0; curABR: 0; ubs: 0; ubr: 0
> 2013-05-27 09:16:09,308 DEBUG [cloud.usage.UsageManagerImpl] (Usage-Job-1:null) created network stats helper entries for 134 accts
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira