You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@aurora.apache.org by "Bill Farner (JIRA)" <ji...@apache.org> on 2015/05/14 01:53:00 UTC
[jira] [Commented] (AURORA-1321) Create bulk version of the
saveJobInstanceUpdateEvent db store method
[ https://issues.apache.org/jira/browse/AURORA-1321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14542932#comment-14542932 ]
Bill Farner commented on AURORA-1321:
-------------------------------------
You should weigh against benchmarking SnapshotStoreImpl.applySnapshot. This is a wider net than the method above, but should provide reusable scaffolding for other recovery speed efforts.
> Create bulk version of the saveJobInstanceUpdateEvent db store method
> ---------------------------------------------------------------------
>
> Key: AURORA-1321
> URL: https://issues.apache.org/jira/browse/AURORA-1321
> Project: Aurora
> Issue Type: Bug
> Components: Scheduler
> Reporter: Maxim Khutornenko
> Assignee: Maxim Khutornenko
>
> Perf analysis revealed unsatisfactory performance of the job update instance insertion implementation during snapshot recovery. It may take up to 5 minutes to process a total of ~100K instance events during scheduler restart.
> Implement and benchmark the bulk insert version of this api: https://github.com/apache/aurora/blob/b436ec52101cfd5d6f65075a5f7a857ed5a41b5f/src/main/java/org/apache/aurora/scheduler/storage/JobUpdateStore.java#L152
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)