You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/07/29 07:27:07 UTC

[GitHub] [arrow] jhirshman opened a new issue #7850: Upgrading 0.15 -> 1.0 -- deserializing fails

jhirshman opened a new issue #7850:
URL: https://github.com/apache/arrow/issues/7850


   I have pandas dataframes that were serialized using pyarrow 0.15.1.
   I am now trying to upgrade to 1.0.
   
   When trying to read the old files with 1.0, I get the following error messages:
   - pyarrow.lib.ArrowInvalid: Cannot read pre-1.0.0 Union array with top-level validity bitmap
   - OSError: Expected IPC message of type unknown but got unknown
   
   Is there any chance I can modify the files to preserve compatibility?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] wesm closed issue #7850: Upgrading pyarrow 0.15 -> 1.0 -- deserializing fails

Posted by GitBox <gi...@apache.org>.
wesm closed issue #7850:
URL: https://github.com/apache/arrow/issues/7850


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] wesm commented on issue #7850: Upgrading pyarrow 0.15 -> 1.0 -- deserializing fails

Posted by GitBox <gi...@apache.org>.
wesm commented on issue #7850:
URL: https://github.com/apache/arrow/issues/7850#issuecomment-665311158


   These serialization functions never contained any backward compatibility guarantees and are going to be deprecated soon. I would recommend reading the files with <= 0.17.1 and writing them in some other format (Arrow IPC files or Parquet files)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org