You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by "bxb100 (via GitHub)" <gi...@apache.org> on 2023/03/31 12:58:03 UTC

[GitHub] [incubator-opendal] bxb100 opened a new issue, #1821: feature request: support stream upload

bxb100 opened a new issue, #1821:
URL: https://github.com/apache/incubator-opendal/issues/1821

   typically code like this:
   ```rust
   let mut file = File::open("bigfile").await.unwrap();
   let mut vec = Vec::new();
   file.read_to_end(&mut vec).await?;
   // ..snipper
   op.write("file", vec).await?;
   ```
   it will load the file into memory at first, but  
   [reqwest-0.11.15/src/async_impl/body.rs:218](https://github.com/seanmonstar/reqwest/blob/704766979f734a81ce35e70361b2f97b4ab6c130/src/async_impl/body.rs#L216-L223) originall support stream upload 
   
   I test different ways to upload a 1GB file, and the process usage:
   
   using stream:
   <img width="707" alt="image" src="https://user-images.githubusercontent.com/20685961/229125845-c2604710-55c0-4449-a388-e49ee6dfdad7.png">
   
   not using stream:
   <img width="700" alt="image" src="https://user-images.githubusercontent.com/20685961/229126197-c127c536-a196-4f59-802d-c61d3040de43.png">
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-opendal] Xuanwo commented on issue #1821: feature request: support stream upload

Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #1821:
URL: https://github.com/apache/incubator-opendal/issues/1821#issuecomment-1491893780

   Great observation! We previously supported this feature, but it was removed during a refactor. Rest assured, we will be adding it back soon. :laughing:


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-opendal] Xuanwo closed issue #1821: feature request: support stream upload

Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo closed issue #1821: feature request: support stream upload
URL: https://github.com/apache/incubator-opendal/issues/1821


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-opendal] Xuanwo commented on issue #1821: feature request: support stream upload

Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on issue #1821:
URL: https://github.com/apache/incubator-opendal/issues/1821#issuecomment-1648844155

   Implemented!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org