You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "Cq-study (via GitHub)" <gi...@apache.org> on 2026/03/03 06:03:50 UTC
[I] [Enhancement] 使用连接器CdcTools包启动任务后，flink任务的overview相关指标数据都为0 [doris-flink-connector]
Cq-study opened a new issue, #639:
URL: https://github.com/apache/doris-flink-connector/issues/639
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Description
Bytes Received 、 Records Received 、 Bytes Sent 、 Records Sent 这4个有关数据量的指标都为0，像是没采集上来。 是要在任务中添加什么参数吗？
### Solution
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Enhancement] 使用连接器CdcTools包启动任务后，flink任务的overview相关指标数据都为0 [doris-flink-connector]
Posted by "Cq-study (via GitHub)" <gi...@apache.org>.
Cq-study closed issue #639: [Enhancement] 使用连接器CdcTools包启动任务后，flink任务的overview相关指标数据都为0
URL: https://github.com/apache/doris-flink-connector/issues/639
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Enhancement] 使用连接器CdcTools包启动任务后，flink任务的overview相关指标数据都为0 [doris-flink-connector]
Posted by "Cq-study (via GitHub)" <gi...@apache.org>.
Cq-study commented on issue #639:
URL: https://github.com/apache/doris-flink-connector/issues/639#issuecomment-5825068606
Resolved by #681 (standard FLIP-33 sink metrics are now reported); the zeros on the overview page itself are expected Flink behavior for a fully chained job, as explained above. Closing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [I] [Enhancement] 使用连接器CdcTools包启动任务后，flink任务的overview相关指标数据都为0 [doris-flink-connector]
Posted by "Cq-study (via GitHub)" <gi...@apache.org>.
Cq-study commented on issue #639:
URL: https://github.com/apache/doris-flink-connector/issues/639#issuecomment-5084113235
After digging into this, the zeros on the overview page are expected Flink behavior rather than a connector bug:
- The overview "Bytes/Records Received/Sent" numbers only count data exchanged **between tasks** (over the network). A CdcTools job (`CDC source -> ParsingProcessFunction -> side outputs -> Doris sinks`) is fully chainable, so the whole pipeline runs as a single task and there is no inter-task edge to count.
- Additionally, sources never report "Records Received" and sinks never report "Records Sent" on the overview, because external-system I/O is not part of these task-level metrics.
What you can do today:
1. Check the sink operator's **Metrics tab**: the connector reports per-table counters such as `<table>_totalFlushLoadedRows` / `<table>_totalFlushLoadBytes`.
2. For debugging, disable operator chaining (`pipeline.operator-chaining: false`) to make the internal edges visible (at a performance cost).
I've also opened #681 which wires the standard FLIP-33 sink metrics `numRecordsSend` / `numBytesSend` into the Doris sink, so standard dashboards and the metrics tab can observe sink throughput without knowing the connector-specific counter names.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org