You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2019/08/22 18:12:00 UTC

[jira] [Created] (ARROW-6325) [Python] wrong conversion of DataFrame with boolean values

Joris Van den Bossche created ARROW-6325:
--------------------------------------------

             Summary: [Python] wrong conversion of DataFrame with boolean values
                 Key: ARROW-6325
                 URL: https://issues.apache.org/jira/browse/ARROW-6325
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 0.14.1
            Reporter: Joris Van den Bossche
             Fix For: 0.15.0


From https://github.com/pandas-dev/pandas/issues/28090

{code}
In [19]: df = pd.DataFrame(np.ones((5, 2), dtype=bool), columns=['a', 'b']) 

In [20]: df  
Out[20]: 
      a     b
0  True  True
1  True  True
2  True  True
3  True  True
4  True  True

In [21]: table = pa.table(df) 

In [23]: table.column(0)
Out[23]: 
<pyarrow.lib.ChunkedArray object at 0x7fd08a96e090>
[
  [
    true,
    false,
    false,
    false,
    false
  ]
]
{code}

The resulting table has False values while the original DataFrame had only true values. 
It seems this has to do with the fact that it are multiple columns, as with a single column it converts correctly.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)