[jira] [Commented] (YARN-6375) App level aggregation should not consider metric values reported in the previous aggregation cycle

["Varun Saxena (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/YARN-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937266#comment-15937266 ] 

Varun Saxena commented on YARN-6375:
------------------------------------

Assume in the first 15 second period, entities reported with corresponding metric values for metric1 are as under:
{entity1: metric1=50, entity2: metric1=100, entity3: metric1=150, entity4: metric1=200, entity5: metric1=250}

When aggregation occurs(SUM operation) we would write out app entity with metric1 having corresponding value of 750.

Let us say by next 15 second period, entity1 and entity2 finish and following metric values are reported.
{entity3: metric1=50, entity4: metric1=70, entity5: metric1=90}

When aggregation occurs(SUM operation) we would write out app entity with metric1 having corresponding value of 360.

I think the value reported should be 210.

> App level aggregation should not consider metric values reported in the previous aggregation cycle
> --------------------------------------------------------------------------------------------------
>
>                 Key: YARN-6375
>                 URL: https://issues.apache.org/jira/browse/YARN-6375
>             Project: Hadoop YARN
>          Issue Type: Sub-task
>          Components: timelineserver
>            Reporter: Varun Saxena
>
> Currently app level aggregation is done every 15 seconds.
> And we consider last reported metric value for each entity belonging to an app for aggregation.
> We however merely update the corresponding metric values for the entity on put. We never remove the entries.
> But it is possible that multiple entities finish during lifetime of an application. We however continue to consider them till the end.
> We should however not consider metric values of entities unless reported within the 15 second period.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org