You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pulsar.apache.org by GitBox <gi...@apache.org> on 2021/01/28 11:18:31 UTC
[GitHub] [pulsar-helm-chart] rvashishth opened a new issue #103: Add node_exporter template
rvashishth opened a new issue #103:
URL: https://github.com/apache/pulsar-helm-chart/issues/103
**Is your feature request related to a problem? Please describe.**
The grafana dashboards should display metrics for nodes and containers. Use prometheus `node_exporter` to export kubernetes node metrics.
**Describe the solution you'd like**
Define node exporter template as defined at [streamnative charts](https://github.com/streamnative/charts/blob/master/charts/pulsar/templates/node-exporter/node-exporter.yaml)
**Additional context**
Although [`monitoring.node_exporter`](https://github.com/apache/pulsar-helm-chart/blob/master/charts/pulsar/values.yaml#L125) is enabled at values.yml file but it seems no template for node_exporters are defined yet.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar-helm-chart] mkoertgen edited a comment on issue #103: Add node_exporter template
Posted by GitBox <gi...@apache.org>.
mkoertgen edited a comment on issue #103:
URL: https://github.com/apache/pulsar-helm-chart/issues/103#issuecomment-780028483
Added as mentioned above with `podAnnotations.scrape: true`.
This kind of works but lacks the `kubelet_volume_stats_*` metrics which were helpful in monitoring the ledger-usage of the bookies.
It has been reported that this has changed since 1.12 of the exporter and there in ongoing discussion on pvc metrics, cf.:
- https://github.com/prometheus-operator/prometheus-operator/issues/2359
Not quite solved yet.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar-helm-chart] mkoertgen commented on issue #103: Add node_exporter template
Posted by GitBox <gi...@apache.org>.
mkoertgen commented on issue #103:
URL: https://github.com/apache/pulsar-helm-chart/issues/103#issuecomment-780018152
Probably removed because most clusters will typically already have a similar daemonset?
As a workaround can we just deploy a standard node-exporter?
- https://github.com/prometheus-community/helm-charts/tree/main/charts/prometheus-node-exporter
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar-helm-chart] mkoertgen edited a comment on issue #103: Add node_exporter template
Posted by GitBox <gi...@apache.org>.
mkoertgen edited a comment on issue #103:
URL: https://github.com/apache/pulsar-helm-chart/issues/103#issuecomment-780028483
Added as mentioned above with `podAnnotations.scrape: true`.
This kind of works but lacks the `kubelet_volume_stats_*` metrics which were helpful in monitoring e.g. the ledger-usage of the bookies.
Some of the pular-provisioned grafana-dashboards rely on that, e.g. the "Bookie Metrics"-dashboard
As you can see the PVC metrics show no data because neither the `kubelet_volume_stats_available_bytes` nor `kubelet_volume_stats_capacity_bytes` is exported anymore. However `bookie_ledger_dir__pulsar_data_bookkeeper_ledgers_usage` is still there
It has been reported that this has changed since 1.12 of the exporter and there in ongoing discussion on pvc metrics, cf.:
- https://github.com/prometheus-operator/prometheus-operator/issues/2359
It did not dig into the issue in detail but my understanding so far is that this neither solved yet nor is there a clear path how to go about this.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [pulsar-helm-chart] mkoertgen commented on issue #103: Add node_exporter template
Posted by GitBox <gi...@apache.org>.
mkoertgen commented on issue #103:
URL: https://github.com/apache/pulsar-helm-chart/issues/103#issuecomment-780028483
Added as mentioned above with podAnnotations scrape: true
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org