You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by "jorisvandenbossche (via GitHub)" <gi...@apache.org> on 2024/05/01 07:58:29 UTC

Re: [I] [Python] Segfault in `to_pandas()` on batch from IPC stream in specific edge cases [arrow]

jorisvandenbossche commented on issue #41469:
URL: https://github.com/apache/arrow/issues/41469#issuecomment-2088115626

   Thanks for the report!
   
   > I was unable to reproduce with an IPC stream fully in python created from a pyarrow table.
   
   Could you try creating an IPC file from the pyspark dataframe? (I don't know if pyspark provides the functionality for that) Or can you convert the pyspark dataframe to pyarrow first (not going through pandas), and then save it?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org