You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@aurora.apache.org by "Joe Smith (JIRA)" <ji...@apache.org> on 2014/01/27 07:02:38 UTC
[jira] [Updated] (AURORA-122) Introduce a task store secondary
index on slave host
[ https://issues.apache.org/jira/browse/AURORA-122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Joe Smith updated AURORA-122:
-----------------------------
Labels: O2 (was: )
> Introduce a task store secondary index on slave host
> ----------------------------------------------------
>
> Key: AURORA-122
> URL: https://issues.apache.org/jira/browse/AURORA-122
> Project: Aurora
> Issue Type: Story
> Components: Reliability, Scheduler
> Reporter: Bill Farner
> Assignee: Bill Farner
> Labels: O2
>
> We've observed the {{resourceOffers}} callback taking longer than desired in large clusters. Timing has indicated that they take as long as 100ms regularly, with occasional calls taking as long as a minute. We've narrowed down the majority of time spent to be performing expensive task store queries by slave host (in {{GcExecutorLauncher}}. When lots of hosts and tasks are present, these calls should be considerably faster if we maintain a index on slave host to avoid full task store scans.
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)