[jira] [Commented] (UIMA-4882) DUCC Resource Manager (RM) does not adequately expand Job Processes (JPs)

["Lou DeGenaro (JIRA)" <de...@uima.apache.org>]

    [ https://issues.apache.org/jira/browse/UIMA-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15224683#comment-15224683 ] 

Lou DeGenaro commented on UIMA-4882:
------------------------------------

1. Modify Job Driver to produce additional information in it's Message Handler for handleGetOperatingInfo() comprising:
- WorkItemRunningAboveAvgMillis
- WorkItemRunningAboveAvgCount
- WorkItemSkewAvg
2. Modify RunningWorkItemStatistics to keep track of:
- AboveAvgMillis
- AboveAvgCount
for use when producing OperatingInfo above
3. Modify WorkItemStatistics to facilitate getCount() of completed work items, also for use when producing OperatingInfo above

> DUCC Resource Manager (RM) does not adequately expand Job Processes (JPs)
> -------------------------------------------------------------------------
>
>                 Key: UIMA-4882
>                 URL: https://issues.apache.org/jira/browse/UIMA-4882
>             Project: UIMA
>          Issue Type: Improvement
>          Components: DUCC
>            Reporter: Lou DeGenaro
>            Assignee: Lou DeGenaro
>             Fix For: 2.1.0-Ducc
>
>
> The Resource Manager (RM) employs a mean work item completion time published by the Orchestrator (OR) to predict Job Processes (JP) usage for resource allocation.  Presently this mean only considers completed work items, not active ones, and therefore may not reflect the benefits of more resource allocation to a Job.
> A revised algorithm for calculating the work item prediction mean is:
> 1. calculate mean of completed work items
> 2. find active work items > completed mean
> 3. calculate new mean comprising completed + longer active work items
> 4. publish same



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)