[GitHub] [hadoop] steveloughran commented on pull request #3499: HADOOP-11867. Add a high performance vectored read API to file system.

[GitBox <gi...@apache.org>]

steveloughran commented on pull request #3499:
URL: https://github.com/apache/hadoop/pull/3499#issuecomment-930298150


   Quick review. 
   * needs filesystem spec
   * and a contract test
   * test to include 
     -overlapping ranges
     -beyond file length
     -negative values
     -on heap and off heap buffers
   
   * be good to have a PoC of the s3a one, so that we can happy the API xfers to the store
   * and some ORC/parquet branch which shows it can be used
   * is there any API we'd want, e.g an fs command which does a single async ranged get
   ```
   hadoop fs ranged -start 0 -end 345  -out output.txt s3a://file
   ```
   would be good for QE tests
   * and we should have a path capability. Anything which supports seek will also do this (so ftp won't)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org