You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "fenixjin (via GitHub)" <gi...@apache.org> on 2025/01/07 18:09:14 UTC

Re: [PR] HDDS-10338. Implement a Client Datanode API to stream a block [ozone]

fenixjin commented on PR #6613:
URL: https://github.com/apache/ozone/pull/6613#issuecomment-2575932018

   > > Test conducted on our cluster(3DN / HDD / 10 Gigabit network) shows this improvement can boost read speed by at least 30%.
   > 
   > > It can be seen that for 1GB file reading, streaming reading can reduce the reading time by about 30%.
   > 
   > Hi @chungen0126 @guohao-rosicky, do we know how much of an improvement is being seen for files smaller than 1GB?
   
   @ptlrs 
   conducted test using freon on the latest version of this pr, hardware is 3DN / HDD / 10 Gigabit network, tested file sizes are 1GB 128MB 16MB 2MB 256KB. there is an index bug when verifying checksum, tests were conducted after fixing it.
   here are the redunctions in mean read time given by freon:
   - 1GB: 7%
   - 128MB: 10%
   - 16MB 8%
   - 2MB 10%
   - 256KB 8%
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org