You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2021/12/14 10:08:26 UTC

[GitHub] [beam] phoerious commented on pull request #15931: Make S3 streaming more efficient

phoerious commented on pull request #15931:
URL: https://github.com/apache/beam/pull/15931#issuecomment-993377086


   Thanks for the comments. I fixed a bunch of stuff and added some comments myself.
   
   As for the (pseudo-)statefulness, this is absolute essential, but as commented above, I don't think it's an issue. In fact, in a real-world scenario, the speed gain by making the client stateful is way higher than the raw client benchmark above suggests (more like 20-60x). Without keeping the connection open and reading sequentially, the client is so slow that I can hardly imagine anyone actually using it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org