You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Uwe L. Korn (JIRA)" <ji...@apache.org> on 2017/07/11 20:00:00 UTC

[jira] [Assigned] (ARROW-1187) Serialize a DataFrame with None column

     [ https://issues.apache.org/jira/browse/ARROW-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Uwe L. Korn reassigned ARROW-1187:
----------------------------------

    Assignee: Uwe L. Korn

> Serialize a DataFrame with None column
> --------------------------------------
>
>                 Key: ARROW-1187
>                 URL: https://issues.apache.org/jira/browse/ARROW-1187
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: Python
>    Affects Versions: 0.4.1
>            Reporter: Panagiotis Mavrogiorgos
>            Assignee: Uwe L. Korn
>             Fix For: 0.5.0
>
>
> {code}
> import pandas as pd
> import feather
> pd.__version__
> feather.version.version
> df = pd.DataFrame({"A": (1, 2, 3), "B": (None, None, None)})
> feather.write_dataframe(df, "/tmp/foo.feather")
> {code}
> results in:
> {code}
> ---------------------------------------------------------------------------
> ArrowNotImplementedError                  Traceback (most recent call last)
> <ipython-input-72-799e35eece97> in <module>()
>       6 df
>       7 df.info()
> ----> 8 feather.write_dataframe(df, "/tmp/foo.feather")
> /home/feanor/.virtualenvs/xbrl/lib/python3.6/site-packages/pyarrow/feather.py in write_feather(df, dest)
>     110     writer = FeatherWriter(dest)
>     111     try:
> --> 112         writer.write(df)
>     113     except:
>     114         # Try to make sure the resource is closed
> /home/feanor/.virtualenvs/xbrl/lib/python3.6/site-packages/pyarrow/feather.py in write(self, df)
>      99                 name = str(name)
>     100 
> --> 101             self.writer.write_array(name, col)
>     102 
>     103         self.writer.close()
> pyarrow/io.pxi in pyarrow.lib.FeatherWriter.write_array (/arrow/python/build/temp.linux-x86_64-3.6/lib.cxx:48584)()
> pyarrow/error.pxi in pyarrow.lib.check_status (/arrow/python/build/temp.linux-x86_64-3.6/lib.cxx:7124)()
> ArrowNotImplementedError: NotImplemented: null
> {code}
> The versions are:
> {code}
> pandas: '0.19.2'
> arrow: '0.4.0'
> {code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)