You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by GitBox <gi...@apache.org> on 2020/10/19 16:47:29 UTC

[GitHub] [hadoop] steveloughran commented on pull request #2396: HADOOP-17313. FileSystem.get to support slow-to-instantiate FS clients.

steveloughran commented on pull request #2396:
URL: https://github.com/apache/hadoop/pull/2396#issuecomment-712293705


   For interest of @snvijaya @rajeshbalamohan @mukund-thakur @mehakmeet 
   
   Not thought of a good test yet, at least not one overly destructive. Probably 
   * private Cache instance in test suite (in o.a.h.fs. package) and small semaphore set (2 ?)
   * Slow to create FS with sleep(30s) in initialize
   * executor pool to submit a set of workers, where time to instantiate should be << time to instantiate the set sequentially.
   
   May help to have Cache have an atomic long to count #of FS instances discarded. Actually publishing that as an FS stat would be interesting but out of scope.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org