You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Junfan Zhang (JIRA)" <ji...@apache.org> on 2018/12/05 15:55:00 UTC

[jira] [Comment Edited] (OOZIE-3393) Add Oozie instrumentation delayed metric in CoordMaterializeTriggerService

    [ https://issues.apache.org/jira/browse/OOZIE-3393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16710260#comment-16710260 ] 

Junfan Zhang edited comment on OOZIE-3393 at 12/5/18 3:54 PM:
--------------------------------------------------------------

Thanks [~andras.piros]. I have submitted the {{oozie-3393-2.patch}} and {{oozie-instrumentation.log}} snippets. In addition, I have uploaded the patch in review board.

But I don't know how to add unit tests, because the {{TestMetricsInstrumentation}} and {{TestInstrumentation}} classes are all general method, not to test specific metrics. If you know, please tell me. Thanks :D


was (Author: zuston):
Thanks [~andras.piros]. I have submitted the {{oozie-3379-2.patch}} and {{oozie-instrumentation.log}} snippets. In addition, I have uploaded the patch in review board. 

But I don't know how to add unit tests, because the {{TestMetricsInstrumentation}} and {{TestInstrumentation}} classes are all general method, not to test specific metrics. If you know, please tell me. Thanks :D

> Add Oozie instrumentation delayed metric in CoordMaterializeTriggerService
> --------------------------------------------------------------------------
>
>                 Key: OOZIE-3393
>                 URL: https://issues.apache.org/jira/browse/OOZIE-3393
>             Project: Oozie
>          Issue Type: Improvement
>            Reporter: Junfan Zhang
>            Assignee: Junfan Zhang
>            Priority: Major
>         Attachments: oozie-3393-1.patch, oozie-3393-2.patch, oozie-instrumentation-1.log
>
>
> We have multiple Oozie scheduled clusters. The problem that is currently encountered is that some materialize queues are too late to process during the peak hours of the scheduled tasks. We need to get the metrics of the delay queue for alarm monitoring and adjust the configuration to optimize.
> Currently we have added metrics for queue size and latency in Oozie CoordMaterializeTriggerService class, in order to reflect the general trend of current scheduling.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)