You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Aswin Shakil (Jira)" <ji...@apache.org> on 2025/08/28 19:47:00 UTC
[jira] [Assigned] (HDDS-13613) Remove calculatePipelineBytesWritten from DN code path
[ https://issues.apache.org/jira/browse/HDDS-13613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aswin Shakil reassigned HDDS-13613:
-----------------------------------
Assignee: Aswin Shakil
> Remove calculatePipelineBytesWritten from DN code path
> ------------------------------------------------------
>
> Key: HDDS-13613
> URL: https://issues.apache.org/jira/browse/HDDS-13613
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Aswin Shakil
> Assignee: Aswin Shakil
> Priority: Critical
>
> _XceiverServerRatis#calculatePipelineBytesWritten_ is called everytime when we send a pipeline report, This method goes through all the containers to filter out those container belonging to a pipelineID. In a dense DN, this would cause a bottleneck when we send pipeline report. It would also cause a rippling effect as the pipeline creation will become slow and the piple scrubber in SCM will close this pipeline if the DN doesn't create the pipeline within time. The DN will consisently be in a loop to create and close pipeline which would make the DN unresponsive.
> This _calculatePipelineBytesWritten_ is only used by a metric in SCM an thus it should be removed, These aggregations needs to be done by Prometheus.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org