You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Shoham Debnath (Jira)" <ji...@apache.org> on 2022/11/09 17:22:00 UTC

[jira] [Created] (ARROW-18297) from/to pandas with MultiIndex raises incorrectly

Shoham Debnath created ARROW-18297:
--------------------------------------

             Summary: from/to pandas with MultiIndex raises incorrectly
                 Key: ARROW-18297
                 URL: https://issues.apache.org/jira/browse/ARROW-18297
             Project: Apache Arrow
          Issue Type: Bug
            Reporter: Shoham Debnath


The error only throws, when one Index is RangeIndex and the other isn't
{code:java}
df = pd.DataFrame({"a":[1,2], "b":[3,4]})
df = df.set_index(["a"], append=True)
pa.Table.from_pandas(df).to_pandas()
Traceback (most recent call last):
  File "/Users/debnathshoham/miniconda3/envs/pandas-dev/lib/python3.8/site-packages/IPython/core/interactiveshell.py", line 3378, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-121-bf4b7b5f6b6e>", line 1, in <module>
    pa.Table.from_pandas(df).to_pandas()
  File "pyarrow/array.pxi", line 823, in pyarrow.lib._PandasConvertible.to_pandas
  File "pyarrow/table.pxi", line 3913, in pyarrow.lib.Table._to_pandas
  File "/Users/debnathshoham/miniconda3/envs/pandas-dev/lib/python3.8/site-packages/pyarrow/pandas_compat.py", line 808, in table_to_blockmanager
    table, index = _reconstruct_index(table, index_descriptors,
  File "/Users/debnathshoham/miniconda3/envs/pandas-dev/lib/python3.8/site-packages/pyarrow/pandas_compat.py", line 959, in _reconstruct_index
    result_table, index_level, index_name = _extract_index_level(
  File "/Users/debnathshoham/miniconda3/envs/pandas-dev/lib/python3.8/site-packages/pyarrow/pandas_compat.py", line 997, in _extract_index_level
    logical_name = field_name_to_metadata[field_name]['name']
KeyError: 'a' {code}
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)