You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "kindly (via GitHub)" <gi...@apache.org> on 2023/04/24 20:28:28 UTC
[GitHub] [arrow-rs] kindly opened a new issue, #4119: [object_store] Intermittent failure to put data, especially in multipart uploads.
kindly opened a new issue, #4119:
URL: https://github.com/apache/arrow-rs/issues/4119
**Describe the bug**
When mulitipart_upload to s3 for larger files, I was getting lots of reqwest/hyper errors, e.g `broken pipe`, `tls handshake errors` and `channel closed`, meaning some large files become almost impossible to upload. This could be due to flaky internet or slow processing of data being uploaded.
**To Reproduce**
Hard to reproduce as they were intermittent failures and required large files or delays between requests.
**Expected behaviour**
Ability for the put requests/ multiplart uploads to be retried for more failure cases.
**Additional context**
Have a pull request that does retries for more cases.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold commented on issue #4119: [object_store] Retry requests on connection error
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold commented on issue #4119:
URL: https://github.com/apache/arrow-rs/issues/4119#issuecomment-1536259345
`label_issue.py` automatically added labels {'object-store'} from #4120
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] tustvold closed issue #4119: [object_store] Retry requests on connection error
Posted by "tustvold (via GitHub)" <gi...@apache.org>.
tustvold closed issue #4119: [object_store] Retry requests on connection error
URL: https://github.com/apache/arrow-rs/issues/4119
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org