[GitHub] [hadoop-ozone] timmylicheng commented on issue #393: HDDS-1590 Aggregate bytes write metrics from container to datanode and to SCM

[GitBox <gi...@apache.org>]

timmylicheng commented on issue #393: HDDS-1590 Aggregate bytes write metrics from container to datanode and to SCM
URL: https://github.com/apache/hadoop-ozone/pull/393#issuecomment-585594255
 
 
   > Thanks to post this patch @timmylicheng. Overall it looks good, but I am not sure about the motivation.
   > Why is it required to send metrics from one service to an other one and report from there? The metrics can be published by the datanode itself and can be summarized / organized by the metrics collector.
   > 
   > Is this information required for any of the decision made by the SCM?
   > 
   > I am pretty sure that I missed the context of this patch. Can you please help me to understand the goals?
   
   Sure. This patch is to summarize the bytes in for every pipeline, which requires the sum of each container that is allocated to the pipeline. The bytes in stats for each container shall be collected on datanode to be near real-time. So that I collect them up by datanode reports and aggregate by pipeline on SCM.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org