You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@samza.apache.org by "Roger Hoover (JIRA)" <ji...@apache.org> on 2015/07/11 01:41:04 UTC

[jira] [Created] (SAMZA-733) Add metrics for Elasticsearch Producer

Roger Hoover created SAMZA-733:
----------------------------------

             Summary: Add metrics for Elasticsearch Producer
                 Key: SAMZA-733
                 URL: https://issues.apache.org/jira/browse/SAMZA-733
             Project: Samza
          Issue Type: Improvement
          Components: metrics
            Reporter: Roger Hoover
            Priority: Minor
             Fix For: 0.10.0


Add metrics for Elasticsearch producers.  For now, we'll only track success events (number of successful bulk sends, number of documents inserted, and number of documents updated).  Since the current ES producer fails the job when ES returns an error, there's not benefit yet to tracking negative events because Samza does not seem to flush metrics before shutting down (at least when I tested with ThreadJob.

I've implemented metrics here (https://github.com/Quantiply/rico/tree/master/samza-elasticsearch/src/main/java/org/apache/samza/system/elasticsearch) and will work on creating a patch.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)