[GitHub] [hadoop] cndaimin commented on pull request #4101: HDFS-16519. Add throttler to EC reconstruction

[GitBox <gi...@apache.org>]

cndaimin commented on PR #4101:
URL: https://github.com/apache/hadoop/pull/4101#issuecomment-1106154139

   @tasanuma Thanks for your review and comments! Yes, we have used the feature in our production cluster for nearly 1 year and it looks good.
   
   - `dfs.datanode.data.write.bandwidthPerSec`: Currently we have no limitation on user writes, and when user write bandwidth exceeds the bottleneck of hardware (NIC generally), the write will automatically slow down.
   - `dfs.datanode.ec.reconstruction.xmits.weight`: We keep it to default value of 0.5
   - `dfs.datanode.data.transfer.bandwidthPerSec`: Same as the new added `dfs.datanode.ec.reconstruct.read.bandwidthPerSec`, we set it to half of available network traffic to be sure it will not affect user read/write.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org