Re: [I] object_store: Using `io_uring`? [arrow-rs-object-store]

["CommanderStorm (via GitHub)" <gi...@apache.org>]

CommanderStorm commented on issue #262:
URL: https://github.com/apache/arrow-rs-object-store/issues/262#issuecomment-2976501978

   > I've got no horse in this race, but AnyBlob and their paper are worth a look:
   > 
   > https://github.com/durner/AnyBlob [Exploiting Cloud Object Storage for High-Performance Analytics](https://www.vldb.org/pvldb/vol16/p2769-durner.pdf)
   > 
   > They're using io_uring to accelerate cloud object downloads.
   
   Something I noticed in said paper:
   They do a lot more than just `io_uring`.
   
   Notily, I think the Throughput-based resolver, MTU-based resolver and hedging is quite interesting.
   Never knew, that only part of the S3-fleet does support jumbo frames.
   
   <details><summary>screenshot from the paper listing results</summary>
   <p>
   
   ![Image](https://github.com/user-attachments/assets/fa6ec23c-f1d0-4684-817b-da186ad8e7bb)
   
   </p>
   </details> 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org