You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "wjones127 (via GitHub)" <gi...@apache.org> on 2023/04/08 20:30:15 UTC

[GitHub] [arrow] wjones127 commented on issue #34363: [Python] Writing to cloudflare r2 fails for mutlipart upload

wjones127 commented on issue #34363:
URL: https://github.com/apache/arrow/issues/34363#issuecomment-1500972227

   @elithrar in https://github.com/duckdb/duckdb/issues/5685#issuecomment-1456641554 you said
   
   > If the parts aren't equal (minus the last), then the multi-part upload will fail
   
   Should we take that to mean that R2 requires that the parts, except for the last one, must have an equal size in bytes? We treat the part size as a minimum and dynamically increase the size of the parts. This works well for S3.
   
   https://github.com/apache/arrow/blob/28ca876dc41b696bda8159daa1c4e9be2b799c48/cpp/src/arrow/filesystem/s3fs.cc#L1410-L1423
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org