[jira] [Commented] (ARROW-5952) [Python] Segfault when reading empty table with category as pandas dataframe

["Daniel Nugent (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/ARROW-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906634#comment-16906634 ] 

Daniel Nugent commented on ARROW-5952:
--------------------------------------

FWIW, I tried to figure out where this was getting handled incorrectly, but I got lost somewhere in the C++ layer. Is there any work going forward on resolving the issue? It's a bit annoying to have to check if the tables are empty before trying to load them.

> [Python] Segfault when reading empty table with category as pandas dataframe
> ----------------------------------------------------------------------------
>
>                 Key: ARROW-5952
>                 URL: https://issues.apache.org/jira/browse/ARROW-5952
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: Python
>    Affects Versions: 0.14.0, 0.14.1
>         Environment: Linux 3.10.0-327.36.3.el7.x86_64
> Python 3.6.8
> Pandas 0.24.2
> Pyarrow 0.14.0
>            Reporter: Daniel Nugent
>            Priority: Major
>             Fix For: 1.0.0
>
>
> I have two short sample programs which demonstrate the issue:
> {code:java}
> import pyarrow as pa
> import pandas as pd
> empty = pd.DataFrame({'foo':[]},dtype='category')
> table = pa.Table.from_pandas(empty)
> outfile = pa.output_stream('bar')
> writer = pa.RecordBatchFileWriter(outfile,table.schema)
> writer.write(table)
> writer.close()
> {code}
> {code:java}
> import pyarrow as pa
> pa.ipc.open_file('bar').read_pandas()
> Segmentation fault
> {code}
> My apologies if this was already reported elsewhere, I searched but could not find an issue which seemed to refer to the same behavior.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)