You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by "JNSimba (via GitHub)" <gi...@apache.org> on 2026/04/08 08:43:09 UTC
[PR] [improve](streaming-job) Add per-job metrics for streaming insert jobs [doris]
JNSimba opened a new pull request, #62223:
URL: https://github.com/apache/doris/pull/62223
## Summary
- Add per-job granularity metrics for streaming insert jobs with `job_id` and `job_name` labels
- New metrics: `streaming_job_per_job_scanned_rows`, `streaming_job_per_job_load_bytes`, `streaming_job_per_job_filtered_rows`, `streaming_job_per_job_succeed_task_count`, `streaming_job_per_job_failed_task_count`, `streaming_job_per_job_offset`
- Offset info (current_offset/end_offset) exposed as labels on the offset metric for monitoring
- Existing global aggregated metrics remain unchanged
## Approach
Follows `generateBackendsTabletMetrics()` pattern: on each `/metrics` request, remove all previous per-job metrics then re-register with current job data. This ensures both values and labels (including dynamic offset) are always up-to-date.
## Test plan
- [ ] Verify per-job metrics appear in `/metrics?type=json` with correct `job_id` and `job_name` labels
- [ ] Verify offset label contains `current_offset` and `end_offset`
- [ ] Verify existing global streaming job metrics still present
- [ ] Verify FE replay is not affected
- [ ] Run `test_streaming_mysql_job_metrics.groovy` regression test
🤖 Generated with [Claude Code](https://claude.com/claude-code)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](streaming-job) Add per-job metrics for streaming insert jobs [doris]
Posted by "Thearas (via GitHub)" <gi...@apache.org>.
Thearas commented on PR #62223:
URL: https://github.com/apache/doris/pull/62223#issuecomment-4204969404
Thank you for your contribution to Apache Doris.
Don't know what should be done next? See [How to process your PR](https://cwiki.apache.org/confluence/display/DORIS/How+to+process+your+PR).
Please clearly describe your PR:
1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
3. What features were added. Why was this function added?
4. Which code was refactored and why was this part of the code refactored?
5. Which functions were optimized and what is the difference before and after the optimization?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
Re: [PR] [improve](streaming-job) Add per-job metrics for streaming insert jobs [doris]
Posted by "JNSimba (via GitHub)" <gi...@apache.org>.
JNSimba closed pull request #62223: [improve](streaming-job) Add per-job metrics for streaming insert jobs
URL: https://github.com/apache/doris/pull/62223
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org