You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "ion-elgreco (via GitHub)" <gi...@apache.org> on 2025/05/25 09:43:00 UTC

[I] Memory pointer from external source (e.g, FFI) is not aligned for empty list[str] [arrow-rs]

ion-elgreco opened a new issue, #7549:
URL: https://github.com/apache/arrow-rs/issues/7549

   **Describe the bug**
   Can't consume arrow data with empty list[str] over FFI
   
   
   **To Reproduce**
   ```python
   import polars as pl
   from arro3.core import Table
   df = pl.DataFrame(
       {
           "bar": [[]],
       }, schema={"bar": pl.List(pl.String)}
   )
   
   Table(df)
   ```
   
   **Expected behavior**
   Pyarrow seems to be able to consume this empty list[str] fine,
   
   ```python
   import polars as pl
   import pyarrow as pa
   df = pl.DataFrame(
       {
           "bar": [[]],
       }, schema={"bar": pl.List(pl.String)}
   )
   
   pa.table(df)
   ```
   
   **Additional context**
   Created also issue in polars repo: https://github.com/pola-rs/polars/issues/22935, since it's not clear to me where the issue lies, wether it's polars buffers being misaligned or arrow-rs incorrectly identifying it because pyarrow seems to be able to consume it fine.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Memory pointer from external source (e.g, FFI) is not aligned for empty list[str] [arrow-rs]

Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #7549: Memory pointer from external source (e.g, FFI) is not aligned for empty list[str]
URL: https://github.com/apache/arrow-rs/issues/7549


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [I] Memory pointer from external source (e.g, FFI) is not aligned for empty list[str] [arrow-rs]

Posted by "viirya (via GitHub)" <gi...@apache.org>.
viirya commented on issue #7549:
URL: https://github.com/apache/arrow-rs/issues/7549#issuecomment-3126115149

   I reproduced the reported issue locally with a arro3 test case to arro3 repo.
   
   Proposed #8009 as a fix. I verified that after applying the patch, the Python test case can run without issue.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org