You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Roger Hoover (JIRA)" <ji...@apache.org> on 2015/07/14 08:04:05 UTC

[jira] [Updated] (SAMZA-733) Add metrics for Elasticsearch Producer

     [ https://issues.apache.org/jira/browse/SAMZA-733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Roger Hoover updated SAMZA-733:
-------------------------------
    Attachment: SAMZA-733.patch

> Add metrics for Elasticsearch Producer
> --------------------------------------
>
>                 Key: SAMZA-733
>                 URL: https://issues.apache.org/jira/browse/SAMZA-733
>             Project: Samza
>          Issue Type: Improvement
>          Components: metrics
>            Reporter: Roger Hoover
>            Assignee: Roger Hoover
>            Priority: Minor
>             Fix For: 0.10.0
>
>         Attachments: SAMZA-733.patch
>
>
> Add metrics for Elasticsearch producers.  For now, we'll only track success events (number of successful bulk sends, number of documents inserted, and number of documents updated).  Since the current ES producer fails the job when ES returns an error, there's not benefit yet to tracking negative events because Samza does not seem to flush metrics before shutting down (at least when I tested with ThreadJob.
> I've implemented metrics here (https://github.com/Quantiply/rico/tree/master/samza-elasticsearch/src/main/java/org/apache/samza/system/elasticsearch) and will work on creating a patch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)