You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uniffle.apache.org by GitBox <gi...@apache.org> on 2022/08/19 14:30:54 UTC
[GitHub] [incubator-uniffle] xianjingfeng opened a new issue, #169: [Feature Request] Support push metrics to Prometheus Pushgateway
xianjingfeng opened a new issue, #169:
URL: https://github.com/apache/incubator-uniffle/issues/169
The push mode will be more convenient and more real-time. We have implemented it. If necessary, I will create a PR
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] xianjingfeng commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
xianjingfeng commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1221936956
1.We need install node exporter in every host, and if not, real-time performance cannot be ensured.
2.We need change the configration of node exporter after we add an instance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] jerqi closed issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
jerqi closed issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
URL: https://github.com/apache/incubator-uniffle/issues/169
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
zuston commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1334910507
Let's reopen this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
jerqi commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1221732090
Why will the push mode be more convenient and more real-time? Could you give some examples?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
jerqi commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1333858070
> @jerqi Can you share how do you collect metrics in your k8s cluster?
We plan to use a k8s sidecar to collect the metrics.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] xianjingfeng commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
xianjingfeng commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1221937671
1.We need install node exporter in every host, and if not, real-time performance cannot be ensured.
2.We need change the configration of node exporter after we add an instance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] xianjingfeng commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
xianjingfeng commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1221967227
This depends on operation and maintenance. If automation tools is well, it may not be inconvenient.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] xianjingfeng commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
xianjingfeng commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1333853361
@jerqi Can you share how do you collect metrics in your k8s cluster?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
jerqi commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1334918803
Should we have a concept of MetricsReporter refer to Flink first?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] xianjingfeng closed issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
xianjingfeng closed issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
URL: https://github.com/apache/incubator-uniffle/issues/169
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
jerqi commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1221952925
In our production environment, we use `crontab` to fetch the servers' metrics every minute and push the metrics to our prometheus server. I don't get the difference if we use exporter.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] xianjingfeng commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
xianjingfeng commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1333874106
I think we should support export metrics, like hadoop,hbase etc. Users can implement custom export plugin to export metrics to their monitoring system. WDYT? @jerqi
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
jerqi commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1333886953
> I think we should support export metrics, like hadoop,hbase etc. Users can implement custom export plugin to export metrics to their monitoring system. WDYT? @jerqi
I'm not familiar with this aspect. If other mature systems have this , I think it will be ok for me. @zuston Do you have some suggestion?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
zuston commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1334910354
The similar mechanism is supported by other systems, like Flink: https://nightlies.apache.org/flink/flink-docs-release-1.13/docs/deployment/metric_reporters/
I think this is a good improvement of observability
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #169: [Feature Request] Support push metrics to Prometheus Pushgateway
Posted by GitBox <gi...@apache.org>.
jerqi commented on issue #169:
URL: https://github.com/apache/incubator-uniffle/issues/169#issuecomment-1334911666
> Let's reopen this?
OK.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org