[I] document what happens in case of errors [arrow-rs]

["droundy (via GitHub)" <gi...@apache.org>]

droundy opened a new issue, #7095:
URL: https://github.com/apache/arrow-rs/issues/7095

   I would like to know when `BufWriter::shutdown()` or `flush()` fail whether the write has partially succeeded.  Ideally I'd like to have a way to upload such that the operation will be atomic, and the file will not end up in a partially-uploaded state.
   
   Specifically, I'd like to have documented what the consequences of an error in `flush` or `shutdown` are.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] document what happens in case of errors [arrow-rs]

["tustvold (via GitHub)" <gi...@apache.org>]

tustvold commented on issue #7095:
URL: https://github.com/apache/arrow-rs/issues/7095#issuecomment-2645121516

   All object store operations are atomic, and will never result in partially written files.
   
   The only slight caveat is multipart uploads, which may leave partial uploads behind in certain exceptional cases. See https://docs.rs/object_store/latest/object_store/aws/index.html#multipart-uploads.
   
   As for what happens on error, it depends on the error. In most cases the file won't be committed, however, if there was say a network error after the operation completed, an error will be reported but the operation will have succeeded.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org