You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Yevgeni Litvin (Jira)" <ji...@apache.org> on 2019/11/20 07:54:00 UTC

[jira] [Created] (ARROW-7214) [Python] unpickling a pyarrow table with dictionary fields crashes

Yevgeni Litvin created ARROW-7214:
-------------------------------------

             Summary: [Python] unpickling a pyarrow table with dictionary fields crashes
                 Key: ARROW-7214
                 URL: https://issues.apache.org/jira/browse/ARROW-7214
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 0.15.1, 0.15.0, 0.14.1, 0.14.0
            Reporter: Yevgeni Litvin


The following code crashes on this check:
{code:java}
F1120 07:51:37.523720 12432 array.cc:773]  Check failed: (data->dictionary) != (nullptr) 
{code}
Used pandas 0.24.2. 

 
{code:java}
import cPickle as pickle
import pandas as pd
import pyarrow as pa

df = pd.DataFrame([{"cat": "a", "val":1},{"cat": "b", "val":2} ])
df["cat"] = df["cat"].astype('category')index_table = pa.Table.from_pandas(df, preserve_index=False)

with open('/tmp/zz.pickle', 'wb') as f:
    pickle.dump(index_table, f, protocol=2)

with open('/tmp/zz.pickle', 'rb') as f:
   index_table = pickle.load(f)
{code}
 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)