[GitHub] [arrow] jorisvandenbossche commented on issue #20512: [Python] Quadratic memory usage of Table.to_pandas with nested data

["jorisvandenbossche (via GitHub)" <gi...@apache.org>]

jorisvandenbossche commented on issue #20512:
URL: https://github.com/apache/arrow/issues/20512#issuecomment-1609409673

   This was included in the pyarrow 11.0.0 release, which was already released in January of this year. It was actually included in the release notes, but you might need to know the details about the fix to find it .. Quoting from https://arrow.apache.org/blog/2023/01/25/11.0.0-release/ in the Python bug fixes section:
   
   > Numpy conversion for ListArray is improved taking into account sliced offset, avoiding increased memory usage ([GH-20512](https://github.com/apache/arrow/issues/20512))
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org