You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Antoine Pitrou (JIRA)" <ji...@apache.org> on 2019/04/11 15:21:00 UTC

[jira] [Created] (ARROW-5161) [Python] Cannot convert struct type from Pandas object column

Antoine Pitrou created ARROW-5161:
-------------------------------------

             Summary: [Python] Cannot convert struct type from Pandas object column
                 Key: ARROW-5161
                 URL: https://issues.apache.org/jira/browse/ARROW-5161
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 0.13.0
            Reporter: Antoine Pitrou


As reported on [https://github.com/apache/arrow/issues/4045]. Interestingly, the datatype is inferred correctly.
{code:python}
>>> df = pd.DataFrame({'col': [{'ints': 5, 'strs': 'foo'}, {'ints': 6, 'strs': 'bar'}]})                                                                             
>>> df                                                                                                                                                               
                          col
0  {'ints': 5, 'strs': 'foo'}
1  {'ints': 6, 'strs': 'bar'}
>>> pa.Table.from_pandas(df)                                                                                                                                         
Traceback (most recent call last):
  File "<ipython-input-16-6eac5d0eec08>", line 1, in <module>
    pa.Table.from_pandas(df)
  File "pyarrow/table.pxi", line 1139, in pyarrow.lib.Table.from_pandas
    names, arrays, metadata = dataframe_to_arrays(
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 480, in dataframe_to_arrays
    types)
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 209, in construct_metadata
    field_name=sanitized_name)
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 151, in get_column_metadata
    logical_type = get_logical_type(arrow_type)
  File "/home/antoine/arrow/dev/python/pyarrow/pandas_compat.py", line 79, in get_logical_type
    raise NotImplementedError(str(arrow_type))
NotImplementedError: struct<ints: int64, strs: string>
{code}




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)