You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@dubbo.apache.org by GitBox <gi...@apache.org> on 2022/12/10 14:25:20 UTC
[GitHub] [dubbo] songxiaosheng opened a new issue, #11113: Dubbo可观测性
songxiaosheng opened a new issue, #11113:
URL: https://github.com/apache/dubbo/issues/11113
<!-- If you need to report a security issue please visit https://github.com/apache/dubbo/security/policy -->
- [ ] I have searched the [issues](https://github.com/apache/dubbo/issues) of this repository and believe that this is not a duplicate.
## Describe the proposal
<!-- Please use this for a concrete design proposal for functionality. -->
<!-- If you just want to request a new feature and discuss the possible business value, create a Feature Request. -->
# 简介
Dubbo可观测性包括许多附加功能，帮助您在将应用程序推向生产时监视和管理应用程序。您可以选择使用HTTP端点或JMX来管理和监视应用程序。审计、运行状况和度量收集也可以自动应用于应用程序。
参考SpringBoot3的可观测性
[https://docs.spring.io/spring-boot/docs/current/reference/html/actuator.html#actuator.enabling](https://docs.spring.io/spring-boot/docs/current/reference/html/actuator.html#actuator.enabling)
如何开启Dubbo的可观测性？主要通过引入如下依赖：
```xml
<dependency>
<groupId>org.apache.dubbo</groupId>
<artifactId>dubbo-spring-boot-actuator</artifactId>
<version>${dubbo.version}</version>
</dependency>
```
Dubbo可观测性 Dubbo可观测性主要管理如下几大纬度分别是:
* 指标埋点
* 链路追踪
* 日志打印
* 健康检查
* 文档案例
# 指标Metrics
## 说明
关于指标的设计文档参考：
[https://qnac8r4ct8.feishu.cn/docx/doxcncmY1gYiRGX9ccX264W6JJd](https://qnac8r4ct8.feishu.cn/docx/doxcncmY1gYiRGX9ccX264W6JJd)
指标埋点指标埋点主要从三大中心，消费者，提供者几个纬度细化。让系统更透明。引入micrometer进行指标埋点，用户可以根据实际用户需求进行扩展将指标数据进行转换为需要的格式并输送给第三方系统。
## 指标埋点任务事项
|事项|说明|重要程度|产出|
|:----|:----|:----|:----|
|Grafana Dashboard|Grafana dashboard制作并上传至Grafana官网供用户直接导入|重要|面板配置<br>|
|线程池监控埋点|可监测线程池队列大小，任务被拒绝数量|重要|指标与面板配置<br>|
|消费者请求埋点数据完善调研|梳理现有指标与缺失指标项|重要|文档|
|提供者响应数据埋点完善调研|梳理现有指标与缺失指标项|重要|文档|
|三大中心相关指标数据完善调研|梳理现有指标与缺失指标项|重要|文档|
|其他指标项梳理|其他需要明确的指标项|重要|文档|
|监控平台数据导出|完善当前指标数据导出到其他流行的监控平台（非普罗米修斯）|一般|先调研文档|
|使用案例|完善Demo与接入教程|重要|文档+sample案例|
# 链路追踪
## 说明
链路追踪主要用户管理一个请求链路环节的关键节点，通过引入opentracing或者micrometer tracing 门面默认基于无链路信息用户可以灵活配置日志，第三方链路追踪系统。
|事项|说明|重要程度|产出|
|:----|:----|:----|:----|
|调研门面框架|opentracing与micrometer进行技术选型 |重要|文档<br>|
|提供者trace数据埋点|接收外部来的请求时候获取与产生埋点|重要|文档+代码|
|消费者trace数据埋点|请求下游时候的请求埋点|重要|文档+代码|
|跨线程时候的trace传递|请求中存在的跨线程代码的请求埋点|重要|文档+代码|
|内置链路追踪页面|无第三方链路框架时候可以自行查询的简单页面|一般|文档+代码|
|使用案例|完善Demo与接入教程|重要|文档+sample案例|
# 日志打印
这里包含了Dubbo日志打个方式与常见日志解析，方便用户排查问题，无需研究源码进行分析
|事项|说明|重要程度|产出|
|:----|:----|:----|:----|
|日志配置文档|文档完善即可，包含如何优雅的日志打印比如分层打印框架日志，性能日志等|一般|文档|
|日志兼容trace|这个看trace那边怎么做trace那边将数据埋点到MDC中日志中增加配置即可|一般|文档|
|常见日志解析|针对典型日志要做出案例分析|一般|文档|
# 健康检查
这里涉及到存活健康检查地址URL和可读健康检查URL方便业务系统在物理机中和容器中进行优雅地上下线。
|事项|说明|重要程度|产出|
|:----|:----|:----|:----|
|健康检查配置文档|目前已经实现了梳理好文档|重要|文档|
|健康检查兼容SpringBoot的健康检查与可读检查|兼容SpringBoot|重要|文档+代码|
# 文档案例
这里需要梳理出一个完成的可观测性文档，具体内容可以参考SpringBoot3的，如链接：
[https://docs.spring.io/spring-boot/docs/current/reference/html/actuator.html#actuator.enabling](https://docs.spring.io/spring-boot/docs/current/reference/html/actuator.html#actuator.enabling)
* **可观测性说明文档**：产出背景与架构文档
* **入门使用文档**： 产出入门接入文档
* **入门示例与解析文档**： 产出例子
* **原理解析**： 产出原理文档
* **可观测性实战**： 故障排查案例分析 收集常见Dubbo异常 产出故障分析分类与文档
# 其他需求
* 配置简化: 支持dubbo外置配置文件配置和配置中心配置，用户可灵活开关。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] chickenlj commented on issue #11113: Dubbo 可观测性方案与目标设计
Posted by GitBox <gi...@apache.org>.
chickenlj commented on issue #11113:
URL: https://github.com/apache/dubbo/issues/11113#issuecomment-1373044946
https://github.com/apache/dubbo
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] CrazyHZM commented on issue #11113: Dubbo 可观测性方案与目标设计
Posted by GitBox <gi...@apache.org>.
CrazyHZM commented on issue #11113:
URL: https://github.com/apache/dubbo/issues/11113#issuecomment-1354610556
> 线程池监控埋点
Agree with @robberphex's suggestion, and we need to support protocol extensions in addition to providing a default protocol implementation. The need for observability for some users and enterprises with customization needs to access Dubbo needs to be taken into account at the beginning of the design.
1. The Dubbo main repository will identify default protocols, such as OpenTelemetry
2. The SDK that Dubbo will use to implement these protocols will need to be determined and selected
3. Dubbo will support extensions to the protocols and will complete the implementation of these extensions in [dubbo-spi-extensions](https://github.com/apache/dubbo-spi-extensions) and provide them to users for selection
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] robberphex commented on issue #11113: Dubbo 可观测性方案与目标设计
Posted by GitBox <gi...@apache.org>.
robberphex commented on issue #11113:
URL: https://github.com/apache/dubbo/issues/11113#issuecomment-1354354032
> OpenTelemetry ?
我觉得ot可以作为tracing的protocol，但metrics、log我们仍然需要调研下标准协议。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] robberphex commented on issue #11113: Dubbo 可观测性方案与目标设计
Posted by GitBox <gi...@apache.org>.
robberphex commented on issue #11113:
URL: https://github.com/apache/dubbo/issues/11113#issuecomment-1354216504
是不是可以加上protocol，比如trace的protocol是啥，metrics的protocl是啥。
一方面是企业需要把这个能力纳入到自己系统中的时候，可以用protocol来清楚的知道能不能收这个数据。
另一方面，dubbogo、dubbo rust后面接入的时候，肯定也是面向protocol，而不是micrometer这样的library。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] CherishCai commented on issue #11113: Dubbo 可观测性方案与目标设计
Posted by GitBox <gi...@apache.org>.
CherishCai commented on issue #11113:
URL: https://github.com/apache/dubbo/issues/11113#issuecomment-1354262388
OpenTelemetry ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org
[GitHub] [dubbo] songxiaosheng commented on issue #11113: Dubbo 可观测性方案与目标设计
Posted by GitBox <gi...@apache.org>.
songxiaosheng commented on issue #11113:
URL: https://github.com/apache/dubbo/issues/11113#issuecomment-1354598105
> > OpenTelemetry ?
>
> 我觉得ot可以作为tracing的protocol，但metrics、log我们仍然需要调研下标准协议。
可以再调研下micrometer tracing springboot3中已经支持 micrometer tracing也支持接入OpenTelemetry 再看看前景
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@dubbo.apache.org
For additional commands, e-mail: notifications-help@dubbo.apache.org