You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "Xuanwo (via GitHub)" <gi...@apache.org> on 2024/06/03 09:41:37 UTC

[I] Add BufUploader to implement same feature upon `WriteMultipart` like `BufWriter` [arrow-rs]

Xuanwo opened a new issue, #5834:
URL: https://github.com/apache/arrow-rs/issues/5834

   **Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
   
   During implementing https://github.com/apache/arrow-rs/issues/5766, I find a missing piece of our current API set:
   
   `BufWriter` adaptively uses `put` or `put_multipart`, depending on the volume of data written. However, there is no native implementation for `PutPayload`. This forces users to either use `BufWriter`, which requires an extra copy, or manually implement the adaptive logic.
   
   **Describe the solution you'd like**
   
   I plan to introduce `BufUploader` that fill this gap.
   
   **Describe alternatives you've considered**
   
   None.
   
   **Additional context**
   
   The PR has been sunmitted.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add BufUploader to implement same feature upon `WriteMultipart` like `BufWriter` [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #5834:
URL: https://github.com/apache/arrow-rs/issues/5834#issuecomment-2741681565

   Migrating from arrow-rs issue [#5834](https://github.com/apache/arrow-rs/issues/5834)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add BufUploader to implement same feature upon `WriteMultipart` like `BufWriter` [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #5834:
URL: https://github.com/apache/arrow-rs/issues/5834#issuecomment-2204014277

   `label_issue.py` automatically added labels {'object-store'} from #5835


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Add BufUploader to implement same feature upon `WriteMultipart` like `BufWriter` [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #5834: Add BufUploader to implement same feature upon `WriteMultipart` like `BufWriter`
URL: https://github.com/apache/arrow-rs/issues/5834


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org