You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "carloea2 (via GitHub)" <gi...@apache.org> on 2026/08/31 05:44:40 UTC
[I] Large binary writes can hang after a background upload failure [texera]
carloea2 opened a new issue, #8259:
URL: https://github.com/apache/texera/issues/8259
### What happened?
When the background S3 upload fails while `LargeBinaryOutputStream.write` is filling its bounded queue, the upload worker exits but the producer keeps waiting for queue capacity. The write call can hang forever. Closing the stream can hang for the same reason while enqueueing its EOF marker.
Before: an upload failure with a full queue leaves write and close blocked.
Expected: write and close stop waiting and report the recorded upload failure.
### How to reproduce?
1. Create a `LargeBinaryOutputStream` with a one-item queue.
2. Make the S3 client's `upload_fileobj` fail while writing multiple chunks.
3. Observe that the upload worker exits while `write` remains blocked on the full queue.
### Version or branch
1.3.0-incubating-SNAPSHOT on main
### Commit hash
50321e403c82df299a13deb50a7f9849dd93bdba
### Relevant log output
write_still_blocked=True upload_failed=RuntimeError('live upload failure') queue_full=True
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Large binary writes can hang after a background upload failure [texera]
Posted by "carloea2 (via GitHub)" <gi...@apache.org>.
carloea2 commented on issue #8259:
URL: https://github.com/apache/texera/issues/8259#issuecomment-5548200364
/take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Large binary writes can hang after a background upload failure [texera]
Posted by "kunwp1 (via GitHub) via notifications" <no...@texera.apache.org>.
kunwp1 closed issue #8259: Large binary writes can hang after a background upload failure
URL: https://github.com/apache/texera/issues/8259
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Large binary writes can hang after a background upload failure [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8259:
URL: https://github.com/apache/texera/issues/8259#issuecomment-5474263871
<!-- texera:template-compliance -->
👋 Thanks for opening this issue, @carloea2!
It looks like the issue description doesn't quite follow our template yet:
- This issue doesn't appear to use one of our templates (Bug, Feature, or Task). Please open it using a template so the required details are captured.
Filling out the template helps reviewers understand and triage your contribution faster. Please edit the description to complete it. This message will disappear automatically once the template is followed.
You can find the template prompts by editing the description, or see [CONTRIBUTING.md](https://github.com/apache/texera/blob/main/CONTRIBUTING.md) for the full contribution flow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org