You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 23:28:05 UTC

[GitHub] [beam] damccorm opened a new issue, #21427: upload to s3 fails if last chunk in finish happens to be of 0 length

damccorm opened a new issue, #21427:
URL: https://github.com/apache/beam/issues/21427

   Multipart upload to s3 fails in finish method when last chunk is set to zero length, this happens if original buffer size is between 
   MIN_WRITE_SIZE = 5 * 1024 * 1024
   MAX_WRITE_SIZE = 5 * 1024 * 1024 * 1024
   from put()
   
   Imported from Jira [BEAM-13827](https://issues.apache.org/jira/browse/BEAM-13827). Original Jira may contain additional context.
   Reported by: hoshimura.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] upload to s3 fails if last chunk in finish happens to be of 0 length [beam]

Posted by "damccorm (via GitHub) via github" <gi...@beam.apache.org>.

damccorm closed issue #21427: upload to s3 fails if last chunk in finish happens to be of 0 length
URL: https://github.com/apache/beam/issues/21427


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] upload to s3 fails if last chunk in finish happens to be of 0 length [beam]

Posted by "damccorm (via GitHub) via github" <gi...@beam.apache.org>.

damccorm commented on issue #21427:
URL: https://github.com/apache/beam/issues/21427#issuecomment-6748983115

   Fixed by #16735 (commit b3de798dd7b908297791d02505f3d41d466b8e9e), which skips writing empty final buffer chunks in `S3Uploader.finish()`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org