You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Vikas Saurabh (JIRA)" <ji...@apache.org> on 2016/11/24 21:35:58 UTC
[jira] [Comment Edited] (OAK-4726) Add Metrics coverage to the
Lucene Indexer
[ https://issues.apache.org/jira/browse/OAK-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15694251#comment-15694251 ]
Vikas Saurabh edited comment on OAK-4726 at 11/24/16 9:35 PM:
--------------------------------------------------------------
[~chetanm], I've attached [~ieb@tfd.co.uk]'s [patch|^OAK-4726.patch] rebased atop trunk (and some refactoring).
Currently, the stuff that gets measured are text extraction stats and {{DefaultIndexWriter}} opearations. I haven't added any more stats (although you now have hybrid in place so may be that should get some love too).
The stats as they show up on AEM jmx console look like:
||Attribute Name||Attribute Value||
|Mean|63.379560001489786|
|Max|1935.220386|
|Min|0.003552|
|StdDev|250.87315515958988|
|999thPercentile|1935.220386|
|95thPercentile|308.244552|
|99thPercentile|1935.220386|
|98thPercentile|1070.906412|
|75thPercentile|5.721004|
|50thPercentile|0.026448|
|DurationUnit|milliseconds|
|Count|89|
|MeanRate|0.38123632645532535|
|OneMinuteRate|0.06876635442830437|
|FifteenMinuteRate|0.23484700091005226|
|FiveMinuteRate|0.24990742284539616|
|RateUnit|events/second||
That's for {{org.apache.jackrabbit.oak: "org.apache.jackrabbit.oak.plugins.index.lucene.writer.DefaultIndexWriter-:data-close" (Metrics)}}. There are others for other operations too.
[~ieb@tfd.co.uk], can you also please take a look in case I missed/messed up something.
was (Author: catholicon):
[~chetanm], I've attached [~ieb@tfd.co.uk]'s patch rebased atop trunk (and some refactoring).
Currently, the stuff that gets measured are text extraction stats and {{DefaultIndexWriter}} opearations. I haven't added any more stats (although you now have hybrid in place so may be that should get some love too).
The stats as they show up on AEM jmx console look like:
||Attribute Name||Attribute Value||
|Mean|63.379560001489786|
|Max|1935.220386|
|Min|0.003552|
|StdDev|250.87315515958988|
|999thPercentile|1935.220386|
|95thPercentile|308.244552|
|99thPercentile|1935.220386|
|98thPercentile|1070.906412|
|75thPercentile|5.721004|
|50thPercentile|0.026448|
|DurationUnit|milliseconds|
|Count|89|
|MeanRate|0.38123632645532535|
|OneMinuteRate|0.06876635442830437|
|FifteenMinuteRate|0.23484700091005226|
|FiveMinuteRate|0.24990742284539616|
|RateUnit|events/second||
That's for {{org.apache.jackrabbit.oak: "org.apache.jackrabbit.oak.plugins.index.lucene.writer.DefaultIndexWriter-:data-close" (Metrics)}}. There are others for other operations too.
[~ieb@tfd.co.uk], can you also please take a look in case I missed/messed up something.
> Add Metrics coverage to the Lucene Indexer
> ------------------------------------------
>
> Key: OAK-4726
> URL: https://issues.apache.org/jira/browse/OAK-4726
> Project: Jackrabbit Oak
> Issue Type: Improvement
> Components: lucene
> Affects Versions: 1.5.8
> Reporter: Ian Boston
> Assignee: Chetan Mehrotra
> Fix For: 1.6, 1.5.17
>
> Attachments: OAK-4726.patch
>
>
> Although there are some stats surrounding the Lucene indexing processes it would be useful to have metrics style stats available.
> Looking at the code, the implementations IndexWriter look like the right place to add the metrics. These could be global aggregate metrics, ie one set of metrics covering all IndexWriter implementations, or there could be individual metrics for each Lucene index definition. The latter would be more useful as it will allow detailed stats on individual metrics.
> These metrics will only give information on the writer operations, and not any Tokenizing operations.
> Patch in the form of a pull request will flow.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)