[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #194: HDDS-2241. Optimize the refresh pipeline logic used by KeyManagerImpl…

[GitBox <gi...@apache.org>]

avijayanhwx opened a new pull request #194: HDDS-2241. Optimize the refresh pipeline logic used by KeyManagerImpl…
URL: https://github.com/apache/hadoop-ozone/pull/194
 
 
   … to obtain the pipelines for a key.
   
   ## What changes were proposed in this pull request?
   Currently, while looking up a key, the Ozone Manager gets the pipeline information from SCM through an RPC for every block in the key. For large files > 1GB, we may end up making a lot of RPC calls for this.
   
   This patch proposes a simple change to have a map (method local) of ContainerID -> Pipeline that we get from SCM so that we don't need to make repeated calls to SCM for the same containerID for a key. Here, Number of calls = Number of unique containerIDs.
   
   ## What is the link to the Apache JIRA
   https://issues.apache.org/jira/browse/HDDS-2241
   
   ## How was this patch tested?
   Build, Unit test.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: ozone-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: ozone-issues-help@hadoop.apache.org