You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "ion-elgreco (via GitHub)" <gi...@apache.org> on 2025/12/16 14:52:36 UTC
[I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
ion-elgreco opened a new issue, #578:
URL: https://github.com/apache/arrow-rs-object-store/issues/578
**Describe the bug**
I am reading a large delta table with many files over a mediocre network connection. At some point I see this:
```
thread 'tokio-runtime-worker' panicked at /Users/runner/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/object_store-0.12.3/src/client/http/spawn.rs:86:32:
called `Result::unwrap()` on an `Err` value: SendError { .. }
stack backtrace:
0: 0x122bf6018 - _blake3_compress_in_place_portable
1: 0x122c16f3c - _blake3_compress_in_place_portable
2: 0x122bf21fc - _blake3_compress_in_place_portable
3: 0x122bf5ecc - _blake3_compress_in_place_portable
4: 0x122bf774c - _blake3_compress_in_place_portable
5: 0x122bf759c - _blake3_compress_in_place_portable
6: 0x122bf822c - _blake3_compress_in_place_portable
7: 0x122bf7e58 - _blake3_compress_in_place_portable
8: 0x122bf64dc - _blake3_compress_in_place_portable
9: 0x122bf7b00 - _blake3_compress_in_place_portable
10: 0x122ce0964 - _bz_internal_error
11: 0x122ce0c9c - _bz_internal_error
12: 0x121bdade0 - _blake3_compress_in_place_portable
13: 0x121bc8708 - _blake3_compress_in_place_portable
14: 0x121b2a01c - _blake3_compress_in_place_portable
15: 0x12200bb4c - _blake3_compress_in_place_portable
16: 0x12200b0d4 - _blake3_compress_in_place_portable
17: 0x122018ce8 - _blake3_compress_in_place_portable
18: 0x1220085cc - _blake3_compress_in_place_portable
19: 0x12200aa18 - _blake3_compress_in_place_portable
20: 0x122020300 - _blake3_compress_in_place_portable
21: 0x121ffb60c - _blake3_compress_in_place_portable
22: 0x122012428 - _blake3_compress_in_place_portable
23: 0x12200d9d0 - _blake3_compress_in_place_portable
24: 0x12200e38c - _blake3_compress_in_place_portable
25: 0x122bf9880 - _blake3_compress_in_place_portable
26: 0x183039c08 - __pthread_cond_wait
```
**To Reproduce**
Not sure how tbh, its a combination of network and size of the table.
**Expected behavior**
Don't panic ^^
**Additional context**
<!--
Add any other context about the problem here.
-->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #578:
URL: https://github.com/apache/arrow-rs-object-store/issues/578#issuecomment-3671823675
> [@alamb](https://github.com/alamb) a maintenance release would be helpful :) then we can do some fix releases in delta-rs
- Tracking with https://github.com/apache/arrow-rs-object-store/issues/582
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #578: SpawnService panics tokio-runtime-worker threads
URL: https://github.com/apache/arrow-rs-object-store/issues/578
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
Posted by "ion-elgreco (via GitHub)" <gi...@apache.org>.
ion-elgreco commented on issue #578:
URL: https://github.com/apache/arrow-rs-object-store/issues/578#issuecomment-3671628433
@alamb do you perhaps know which version this landed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #578:
URL: https://github.com/apache/arrow-rs-object-store/issues/578#issuecomment-3671724454
I will make a ticket to track this idea shortly
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #578:
URL: https://github.com/apache/arrow-rs-object-store/issues/578#issuecomment-3671895767
(A workaround for this issue is probably to temporarily fork the SpawnService into delta.rs until the real fix is available)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
Posted by "ion-elgreco (via GitHub)" <gi...@apache.org>.
ion-elgreco commented on issue #578:
URL: https://github.com/apache/arrow-rs-object-store/issues/578#issuecomment-3671665138
@alamb a maintenance release would be helpful :) then we can do some fix releases in delta-rs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #578:
URL: https://github.com/apache/arrow-rs-object-store/issues/578#issuecomment-3671621225
I believe this was fixed by @cetra3 in
- https://github.com/apache/arrow-rs-object-store/pull/442
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #578:
URL: https://github.com/apache/arrow-rs-object-store/issues/578#issuecomment-3671637764
> [@alamb](https://github.com/alamb) do you perhaps know which version this landed?
It isn't released yet -- I am now working on a new version here: 0.13.0
- https://github.com/apache/arrow-rs-object-store/issues/367
However, that will take some time to percolate downstream. Maybe we should also make a maintenance release for 0.12.0 🤔
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] SpawnService panics tokio-runtime-worker threads [arrow-rs-object-store]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #578:
URL: https://github.com/apache/arrow-rs-object-store/issues/578#issuecomment-3725685844
I reviewed this more carefully, and it appears this was actually released as part of 0.12.4: https://github.com/apache/arrow-rs-object-store/commit/c5ec5e530c4ea5791a62ba3a95163d0bb79b2331
So I don't think we have anything to backport
<img width="652" height="455" alt="Image" src="https://github.com/user-attachments/assets/352ba40a-356b-4ffc-9a6e-8c9c9a576bf8" />
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org