You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@couchdb.apache.org by "ai91 (via GitHub)" <gi...@apache.org> on 2023/04/08 15:31:18 UTC
[GitHub] [couchdb] ai91 opened a new issue, #4519: Duplicate metrics on _prometheus endpoint
ai91 opened a new issue, #4519:
URL: https://github.com/apache/couchdb/issues/4519
## Description
When I open `/_node/_local/_prometheus` endpoint with Prometheus metrics, I can find there some metrics are duplicated.
Please find an example of output:
```
...
# TYPE couchdb_erlang_memory_bytes gauge
couchdb_erlang_memory_bytes{memory_type="total"} 63143384
couchdb_erlang_memory_bytes{memory_type="processes"} 21940968
couchdb_erlang_memory_bytes{memory_type="processes_used"} 21928880
couchdb_erlang_memory_bytes{memory_type="system"} 41202416
couchdb_erlang_memory_bytes{memory_type="atom"} 631001
couchdb_erlang_memory_bytes{memory_type="atom_used"} 604146
couchdb_erlang_memory_bytes{memory_type="binary"} 2257800
couchdb_erlang_memory_bytes{memory_type="code"} 13890814
couchdb_erlang_memory_bytes{memory_type="ets"} 2139112
# TYPE couchdb_erlang_gc_collections_total counter
couchdb_erlang_gc_collections_total 58298849
# TYPE couchdb_erlang_gc_words_reclaimed_total counter
couchdb_erlang_gc_words_reclaimed_total 155185713296
# TYPE couchdb_erlang_context_switches_total counter
couchdb_erlang_context_switches_total 173666188
# TYPE couchdb_erlang_reductions_total counter
couchdb_erlang_reductions_total 208340766556
# TYPE couchdb_erlang_processes gauge
couchdb_erlang_processes 471
# TYPE couchdb_erlang_process_limit gauge
couchdb_erlang_process_limit 262144
# TYPE couchdb_erlang_io_recv_bytes_total counter
couchdb_erlang_io_recv_bytes_total 275586867
# TYPE couchdb_erlang_io_sent_bytes_total counter
couchdb_erlang_io_sent_bytes_total 1308200988
# TYPE couchdb_erlang_message_queues gauge
couchdb_erlang_message_queues 0
# TYPE couchdb_erlang_message_queue_min gauge
couchdb_erlang_message_queue_min 0
# TYPE couchdb_erlang_message_queue_max gauge
couchdb_erlang_message_queue_max 0
# TYPE couchdb_erlang_scheduler_queues gauge
couchdb_erlang_scheduler_queues 0
# TYPE couchdb_erlang_dirty_cpu_scheduler_queues gauge
couchdb_erlang_dirty_cpu_scheduler_queues 0
# TYPE couchdb_erlang_memory_bytes gauge
couchdb_erlang_memory_bytes{memory_type="total"} 63143704
couchdb_erlang_memory_bytes{memory_type="processes"} 21941112
couchdb_erlang_memory_bytes{memory_type="processes_used"} 21929024
couchdb_erlang_memory_bytes{memory_type="system"} 41202592
couchdb_erlang_memory_bytes{memory_type="atom"} 631001
couchdb_erlang_memory_bytes{memory_type="atom_used"} 604146
couchdb_erlang_memory_bytes{memory_type="binary"} 2257912
couchdb_erlang_memory_bytes{memory_type="code"} 13890814
couchdb_erlang_memory_bytes{memory_type="ets"} 2139112
# TYPE couchdb_erlang_gc_collections_total counter
couchdb_erlang_gc_collections_total 58298851
# TYPE couchdb_erlang_gc_words_reclaimed_total counter
couchdb_erlang_gc_words_reclaimed_total 155185767836
# TYPE couchdb_erlang_context_switches_total counter
couchdb_erlang_context_switches_total 173666197
# TYPE couchdb_erlang_reductions_total counter
couchdb_erlang_reductions_total 208340788932
# TYPE couchdb_erlang_processes gauge
couchdb_erlang_processes 471
# TYPE couchdb_erlang_process_limit gauge
couchdb_erlang_process_limit 262144
# TYPE couchdb_erlang_ets_table gauge
couchdb_erlang_ets_table 142
```
Please pay attention, for example, on `couchdb_erlang_memory_bytes{memory_type="total"}` element.
In many cases it's not a problem. But leads to issues when this metrics are propagated between Prometheus instances via `remote_write` - the remote instance rejects metrics with error message:
```
caller=write_handler.go:109 level=error component=web msg="Out of order sample from remote write" err="duplicate sample for timestamp" series="{__name__=\"couchdb_erlang_memory_bytes\", instance=\"iddqdcouch\", job=\"couchdb\", memory_type=\"total\"}" timestamp=1680965815828
```
## Steps to Reproduce
- install CouchDB
- open `/_node/_local/_prometheus` endpoint.
## Expected Behaviour
Each metric should be presented only once.
## Your Environment
Couchdb in docker container:
- image: couchdb:3.3.1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] jaydoane closed issue #4519: Duplicate metrics on _prometheus endpoint
Posted by "jaydoane (via GitHub)" <gi...@apache.org>.
jaydoane closed issue #4519: Duplicate metrics on _prometheus endpoint
URL: https://github.com/apache/couchdb/issues/4519
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [couchdb] jaydoane commented on issue #4519: Duplicate metrics on _prometheus endpoint
Posted by "jaydoane (via GitHub)" <gi...@apache.org>.
jaydoane commented on issue #4519:
URL: https://github.com/apache/couchdb/issues/4519#issuecomment-1500917024
I believe this has been fixed in https://github.com/apache/couchdb/pull/4472 and will be available in the next release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@couchdb.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org