You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Shalin Shekhar Mangar (JIRA)" <ji...@apache.org> on 2014/08/07 01:25:12 UTC
[jira] [Updated] (SOLR-6325) Expose per-collection and per-shard
aggregate statistics
[ https://issues.apache.org/jira/browse/SOLR-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shalin Shekhar Mangar updated SOLR-6325:
----------------------------------------
Attachment: SOLR-6325.patch
Here's a rough patch which returns per-shard statistics:
{code}
curl 'http://localhost:8983/solr/admin/collections?action=clusterstatus&stats=true&name=collection1&shard=shard1&wt=json&indent=on'
{code}
{code}
{
"responseHeader":{
"status":0,
"QTime":2023},
"cluster":{
"collections":{
"collection1":{
"shards":{"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{"core_node1":{
"state":"active",
"base_url":"http://127.0.1.1:8983/solr",
"core":"collection1",
"node_name":"127.0.1.1:8983_solr",
"leader":"true"}},
"/update":{
"75thPcRequestTime":0.0,
"15minRateReqsPerSecond":0.0,
"999thPcRequestTime":0.0,
"99thPcRequestTime":0.0,
"95thPcRequestTime":0.0,
"5minRateReqsPerSecond":0.0,
"timeouts":0,
"requests":0,
"avgRequestsPerSecond":0.0,
"errors":0,
"avgTimePerRequest":0.0,
"medianRequestTime":0.0,
"handlerStart":1407367247133,
"totalTime":0.0},
"/select":{
"75thPcRequestTime":26.804607,
"15minRateReqsPerSecond":0.19779007785878447,
"999thPcRequestTime":26.804607,
"99thPcRequestTime":26.804607,
"95thPcRequestTime":26.804607,
"5minRateReqsPerSecond":0.1934432200964012,
"timeouts":0,
"requests":1,
"avgRequestsPerSecond":0.05091259561701815,
"errors":0,
"avgTimePerRequest":26.804607,
"medianRequestTime":26.804607,
"handlerStart":1407367247129,
"totalTime":26.804607},
"/get":{
"75thPcRequestTime":0.0,
"15minRateReqsPerSecond":0.0,
"999thPcRequestTime":0.0,
"99thPcRequestTime":0.0,
"95thPcRequestTime":0.0,
"5minRateReqsPerSecond":0.0,
"timeouts":0,
"requests":0,
"avgRequestsPerSecond":0.0,
"errors":0,
"avgTimePerRequest":0.0,
"medianRequestTime":0.0,
"handlerStart":1407367247131,
"totalTime":0.0},
"/replication":{
"15minRateReqsPerSecond":0.0,
"75thPcRequestTime":0.0,
"999thPcRequestTime":0.0,
"isSlave":"false",
"99thPcRequestTime":0.0,
"95thPcRequestTime":0.0,
"replicateAfter":["commit"],
"5minRateReqsPerSecond":0.0,
"indexPath":"/home/shalin/work/oss/shalin-lusolr/solr/example1/solr/collection1/data/index/",
"replicationEnabled":"true",
"timeouts":0,
"requests":0,
"avgRequestsPerSecond":0.0,
"errors":0,
"avgTimePerRequest":0.0,
"indexSize":"89 bytes",
"indexVersion":0,
"isMaster":"true",
"medianRequestTime":0.0,
"handlerStart":1407367247142,
"generation":1,
"totalTime":0.0}}},
"maxShardsPerNode":"1",
"router":{"name":"compositeId"},
"replicationFactor":"1",
"autoCreated":"true"}},
"live_nodes":["127.0.1.1:7574_solr",
"127.0.1.1:8983_solr"]}}
{code}
The handler names are hard-coded right now but I'm hoping that the work being done in SOLR-6191 will help introspect the capabilities of a node and let us read the names of the interesting handlers.
> Expose per-collection and per-shard aggregate statistics
> --------------------------------------------------------
>
> Key: SOLR-6325
> URL: https://issues.apache.org/jira/browse/SOLR-6325
> Project: Solr
> Issue Type: Sub-task
> Components: SolrCloud
> Reporter: Shalin Shekhar Mangar
> Assignee: Shalin Shekhar Mangar
> Fix For: 4.9, 5.0
>
> Attachments: SOLR-6325.patch
>
>
> SolrCloud doesn't provide any aggregate stats about the cluster or a collection. Very common questions such as document counts per shard, index sizes, request rates etc cannot be answered easily without figuring out the cluster state, invoking multiple core admin APIs and aggregating them manually.
> I propose that we expose an API which returns each of the following on a per-collection and per-shard basis:
> # Document counts
> # Index size on disk
> # Query request rate
> # Indexing request rate
> # Real time get request rate
> I am not yet sure if this should be a distributed search component or a collection API.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org