You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@eagle.apache.org by wujinhu <gi...@git.apache.org> on 2016/09/06 07:53:35 UTC
[GitHub] incubator-eagle pull request #419: [EAGLE-524] aggregation framework-job lev...
GitHub user wujinhu opened a pull request:
https://github.com/apache/incubator-eagle/pull/419
[EAGLE-524] aggregation framework-job level metrics aggregation
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/wujinhu/incubator-eagle aggregation
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-eagle/pull/419.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #419
----
commit f2f0178ebb3cdd83422b1a2a402b46f11809122e
Author: wujinhu <wu...@126.com>
Date: 2016-09-06T07:51:43Z
aggregation framework-job level metrics aggregation
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle issue #419: [EAGLE-524] aggregation framework-job level metr...
Posted by yonzhang <gi...@git.apache.org>.
Github user yonzhang commented on the issue:
https://github.com/apache/incubator-eagle/pull/419
@wujinhu this is pretty important PR, can you add good description so people who are interested in can understand what are those changes for.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle pull request #419: [EAGLE-524] aggregation framework-job lev...
Posted by wujinhu <gi...@git.apache.org>.
Github user wujinhu closed the pull request at:
https://github.com/apache/incubator-eagle/pull/419
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-eagle issue #419: [EAGLE-524] aggregation framework-job level metr...
Posted by wujinhu <gi...@git.apache.org>.
Github user wujinhu commented on the issue:
https://github.com/apache/incubator-eagle/pull/419
The users want to get the aggregation results of job counters group by some dimensions(by cluster/cluster&queue/cluster&queue&user and so on).For example, the Hadoop cluster administrators want to see the trend of HDFS_BYTES_READ in the last three days group by each cluster.
To meet this requirement, I implement this by two steps. This PR is the first step. The second step is contained in https://github.com/apache/incubator-eagle/pull/430
In this PR, the history feeder generates counter metrics when it processed history jobs. When the feeder gets one task of each job, it gets the counters values and generate metric value in each minute by ( counter value / task duration * task run time in each minute). So, we get counter metrics by each job and in each minute.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---