You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@falcon.apache.org by "Balu Vellanki (JIRA)" <ji...@apache.org> on 2014/11/18 22:19:35 UTC
[jira] [Comment Edited] (FALCON-676) Enable metrics for Titan
[ https://issues.apache.org/jira/browse/FALCON-676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216789#comment-14216789 ]
Balu Vellanki edited comment on FALCON-676 at 11/18/14 9:19 PM:
----------------------------------------------------------------
After applying patch and running end2end, the generated metrics in falcon.application.log looks like this.
{code}
2014-11-18 20:50:48,182 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.query.graph.execute.calls, count=3 (metrics:104)
2014-11-18 20:50:48,182 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.query.graph.getNew.calls, count=3 (metrics:104)
2014-11-18 20:50:48,183 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.query.graph.hasDeletions.calls, count=3 (metrics:104)
2014-11-18 20:50:48,183 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.query.vertex.execute.calls, count=8 (metrics:104)
2014-11-18 20:50:48,183 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.query.vertex.getNew.calls, count=8 (metrics:104)
2014-11-18 20:50:48,183 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.query.vertex.hasDeletions.calls, count=8 (metrics:104)
2014-11-18 20:50:48,184 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.stores.getSlice.calls, count=9 (metrics:104)
2014-11-18 20:50:48,184 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.stores.getSlice.entries-returned, count=52 (metrics:104)
2014-11-18 20:50:48,184 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.sys.CachedKeyColumnValueStore.misses, count=8 (metrics:104)
2014-11-18 20:50:48,184 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.sys.CachedKeyColumnValueStore.retrievals, count=8 (metrics:104)
2014-11-18 20:50:48,185 INFO - [metrics-logger-reporter-thread-1:] ~ type=COUNTER, name=com.thinkaurelius.titan.tx.begin, count=1 (metrics:104)
2014-11-18 20:50:48,185 INFO - [metrics-logger-reporter-thread-1:] ~ type=HISTOGRAM, name=com.thinkaurelius.titan.stores.getSlice.entries-histogram, count=9, min=1, max=11, mean=5.777777777777778, stddev=5.044248650140518, median=4.0, p75=11.0, p95=11.0, p98=11.0, p999=11.0 (metrics:108)
2014-11-18 20:50:48,185 INFO - [metrics-logger-reporter-thread-1:] ~ type=TIMER, name=com.thinkaurelius.titan.query.graph.execute.time, count=3, min=0.03362, max=10.229743, mean=3.4533063333333334, stddev=5.868650667575326, median=0.09655599999999999, p75=10.229743, p95=10.229743, p98=10.229743, p999=10.229743, mean_rate=10.229743, m1=0.025108012233780237, m5=0.10426436607026719, m15=0.42281285383122813, rate_unit=0.5339290625928143, duration_unit=events/second (metrics:108)
2014-11-18 20:53:48,192 INFO - [metrics-logger-reporter-thread-1:] ~ type=TIMER, name=com.thinkaurelius.titan.stores.getSlice.time, count=9, min=0.347985, max=1.3848669999999998, mean=0.8925124444444444, stddev=0.4509201914402678, median=0.828805, p75=1.334384, p95=1.3848669999999998, p98=1.3848669999999998, p999=1.3848669999999998, mean_rate=1.3848669999999998, m1=0.030051778950274975, m5=0.01692641259269143, m15=0.7078332975634773, rate_unit=1.3187384419305865, duration_unit=events/second (metrics:108)
{code}
[~ajayyadava] What are we collecting above metrics for?
I suggest writing the logs into a separate file. It should not be going into falcon.application.log.
was (Author: bvellanki):
After applying patch and running end2end, the generated metrics in falcon.application.log looks like this.
{code}
2014-11-18 20:53:48,192 INFO - [metrics-logger-reporter-thread-1:] ~ type=TIMER, name=com.thinkaurelius.titan.stores.getSlice.time, count=9, min=0.347985, max=1.3848669999999998, mean=0.8925124444444444, stddev=0.4509201914402678, median=0.828805, p75=1.334384, p95=1.3848669999999998, p98=1.3848669999999998, p999=1.3848669999999998, mean_rate=1.3848669999999998, m1=0.030051778950274975, m5=0.01692641259269143, m15=0.7078332975634773, rate_unit=1.3187384419305865, duration_unit=events/second (metrics:108)
{code}
[~ajayyadava] I recommend formatting this log a bit and recommend writing the logs into a separate file. It should not be going into falcon.application.log
> Enable metrics for Titan
> ------------------------
>
> Key: FALCON-676
> URL: https://issues.apache.org/jira/browse/FALCON-676
> Project: Falcon
> Issue Type: Sub-task
> Components: metrics
> Affects Versions: 0.6
> Reporter: Venkatesh Seetharam
> Assignee: Ajay Yadav
> Attachments: FALCON-676.patch
>
>
> http://s3.thinkaurelius.com/docs/titan/0.5.0/monitoring.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)