You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@samza.apache.org by rayman7718 <gi...@git.apache.org> on 2018/06/02 01:05:11 UTC

[GitHub] samza pull request #543: Populating ListGauge metric using DiagnosticsAppend...

GitHub user rayman7718 opened a pull request:

    https://github.com/apache/samza/pull/543

    Populating ListGauge metric using DiagnosticsAppender for exceptions

    This PR shows how the ListGauge can be used to emit exceptions using a DiagnosticsAppender.
    1. DiagnosticsAppender is enabled using a config (diagnostics.appender.enable)
    2. DiagnosticsAppender adds exception-events to a listgauge which is a samza container metric
    2. This ListGauge uses a time-and-count based eviction policy, so that exception-events are not emitted to Kafka(SnapshotReporter) forever.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/rayman7718/samza diagnosticsappender

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/samza/pull/543.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #543
    
----
commit 5ae1df9203342e65ea97fbb9471046e036bde74c
Author: Ray Matharu <rm...@...>
Date:   2018-05-10T23:31:07Z

    Added exception metric (as string-guage), to be emitted using the snapshot reporter.
    Switched producer-shutdown logic to ensure metric-flush at shutdown-time

commit 5a3ef7bc09a5ace726c1dcb61d66e036b972e210
Author: Ray Matharu <rm...@...>
Date:   2018-05-30T05:56:02Z

    Adding ListGauge and integration with SamzaContainerMetric

commit 75ef5d20aedf7f2dd0972ff9ddcc3101e28b095d
Author: Ray Matharu <rm...@...>
Date:   2018-05-31T22:33:07Z

    Typifying ListGauge to ListGauge<T>, adding an eviction policy, default policy to retain last N

commit 1efed5a861fe2079827d81781041d1bebb52374d
Author: Ray Matharu <rm...@...>
Date:   2018-05-10T23:31:07Z

    Adding metric type ListGauge
    
    Added exception metric (as string-guage), to be emitted using the snapshot reporter.
    Switched producer-shutdown logic to ensure metric-flush at shutdown-time
    
    Adding ListGauge and integration with SamzaContainerMetric
    
    Typifying ListGauge to ListGauge<T>, adding an eviction policy, default policy to retain last N

commit d2922c56dafb49c40885512760b58ce9528e9ac7
Author: Ray Matharu <rm...@...>
Date:   2018-05-31T22:51:28Z

    Merge branch 'listgauge' of https://github.com/rayman7718/samza into listgauge

commit 6602fa08b119df50022a7eaf56c5ad9be22f656d
Author: Ray Matharu <rm...@...>
Date:   2018-06-01T22:22:34Z

    Adding DiagnosticsAppender, Populating ListGauge exception metric (samza container metric) using DiagnosticsAppender

commit 054d5078ad3ecbd98a85eaa67eeb57c78e2a0f70
Author: Ray Matharu <rm...@...>
Date:   2018-06-02T01:01:27Z

    Adding DiagnosticsExceptionEventEvictionPolicy to evict stale events from ListGauge

----


---

[GitHub] samza pull request #543: JIRA: SAMZA-1733 Populating ListGauge metric using ...

Posted by asfgit <gi...@git.apache.org>.

Github user asfgit closed the pull request at:

    https://github.com/apache/samza/pull/543


---