You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "adsharma (via GitHub)" <gi...@apache.org> on 2026/07/26 16:41:14 UTC
[I] libarrow2500 is not usable with pyarrow==25.0.0 [arrow]
adsharma opened a new issue, #50648:
URL: https://github.com/apache/arrow/issues/50648
### Describe the bug, including details regarding any error messages, version, and platform.
A C++ open source library (icebug) provides python bindings. It needs to link to both C++ libarrow2500 and pyarrow. This was possible in the 23.x and 24.x releases and failing with 25.x as follows:
```
arrow::internal::tracing::UnwrapSpan(arrow::util::tracing::SpanDetails*)
```
is used by `.venv/lib/python3.12/site-packages/pyarrow/libarrow_acero.so.2500`, so we get a failure at "import pyarrow" time. Looking for suggestions on how to resolve.
Repro:
```
uv venv --python 3.12
uv pip install pyarrow
sudo apt-get install -y libarrow-dev=25.0.0-1 # from the apache arrow ubuntu 24.04 repo
nm -D /usr/lib/x86_64-linux-gnu/libarrow.so.2500.0.0 | grep UnwrapSpan # not present
nm -D .venv/lib/python3.12/site-packages/pyarrow/libarrow.so.2500 | grep UnwrapSpan # present
```
```
import mylib # links to /usr/lib/x86_64-linux-gnu/libarrow.so.2500.0.0
import pyarrow # fails with undefined UnwrapSpan
```
This is working ok on windows/macosx. Fails only on linux.
https://github.com/Ladybug-Memory/icebug/pull/56
### Component(s)
C++
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] libarrow2500 is not usable with pyarrow==25.0.0 [arrow]
Posted by "adsharma (via GitHub)" <gi...@apache.org>.
adsharma commented on issue #50648:
URL: https://github.com/apache/arrow/issues/50648#issuecomment-5092741611
icebug/networkit is also a standalone C++ library that has real world users. It needs to link to libarrow.so to be functional.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] libarrow2500 is not usable with pyarrow==25.0.0 [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #50648:
URL: https://github.com/apache/arrow/issues/50648#issuecomment-5168745964
Issue resolved by pull request 50650
https://github.com/apache/arrow/pull/50650
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] libarrow2500 is not usable with pyarrow==25.0.0 [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd closed issue #50648: [C++] libarrow2500 is not usable with pyarrow==25.0.0
URL: https://github.com/apache/arrow/issues/50648
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] libarrow2500 is not usable with pyarrow==25.0.0 [arrow]
Posted by "kou (via GitHub)" <gi...@apache.org>.
kou commented on issue #50648:
URL: https://github.com/apache/arrow/issues/50648#issuecomment-5085373442
@raulcd Can we ensure using `libarrow*.so` bundled in PyArrow from PyArrow even when there are `libarrow*.so` in system or system `libarrow*.so` in system are already loaded?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] libarrow2500 is not usable with pyarrow==25.0.0 [arrow]
Posted by "pitrou (via GitHub)" <gi...@apache.org>.
pitrou commented on issue #50648:
URL: https://github.com/apache/arrow/issues/50648#issuecomment-5093026568
Hmm, perhaps our official Debian / Ubuntu packages should have OpenTelemetry enabled? Other than that, I do not see any simple way to fix this issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [C++] libarrow2500 is not usable with pyarrow==25.0.0 [arrow]
Posted by "raulcd (via GitHub)" <gi...@apache.org>.
raulcd commented on issue #50648:
URL: https://github.com/apache/arrow/issues/50648#issuecomment-5089062376
Mangling or other techniques would still load two full copies of Arrow in the process, so two memory pool registries, two compute function registries, etcetera.
I think the only sensible solution for a use case like that is that a C++ library shipping Python bindings that interop with pyarrow *has* to load the same Arrow the wheels ships, via pyarrow.get_include() / get_library_dirs() / create_library_symlinks.
I don't know the exact use case but this working previously seems to have been just a coincidence rather than something supported.
Can't you avoid linking system libarrow.so (or not adding it into the wheel) and on import to load the libarrow.so provided?
cc @pitrou
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org