You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@arrow.apache.org by "Panagiotis Mavrogiorgos (JIRA)" <ji...@apache.org> on 2017/07/06 12:24:00 UTC

[jira] [Created] (ARROW-1187) Serialize a DataFrame with None column

Panagiotis Mavrogiorgos created ARROW-1187:
----------------------------------------------

             Summary: Serialize a DataFrame with None column
                 Key: ARROW-1187
                 URL: https://issues.apache.org/jira/browse/ARROW-1187
             Project: Apache Arrow
          Issue Type: Improvement
          Components: Python
    Affects Versions: 0.4.0
            Reporter: Panagiotis Mavrogiorgos


{code}
import pandas as pd
import feather
pd.__version__
feather.version.version
df = pd.DataFrame({"A": (1, 2, 3), "B": (None, None, None)})
feather.write_dataframe(df, "/tmp/foo.feather")
{code}
results in:
{code}
---------------------------------------------------------------------------
ArrowNotImplementedError                  Traceback (most recent call last)
<ipython-input-72-799e35eece97> in <module>()
      6 df
      7 df.info()
----> 8 feather.write_dataframe(df, "/tmp/foo.feather")

/home/feanor/.virtualenvs/xbrl/lib/python3.6/site-packages/pyarrow/feather.py in write_feather(df, dest)
    110     writer = FeatherWriter(dest)
    111     try:
--> 112         writer.write(df)
    113     except:
    114         # Try to make sure the resource is closed

/home/feanor/.virtualenvs/xbrl/lib/python3.6/site-packages/pyarrow/feather.py in write(self, df)
     99                 name = str(name)
    100 
--> 101             self.writer.write_array(name, col)
    102 
    103         self.writer.close()

pyarrow/io.pxi in pyarrow.lib.FeatherWriter.write_array (/arrow/python/build/temp.linux-x86_64-3.6/lib.cxx:48584)()

pyarrow/error.pxi in pyarrow.lib.check_status (/arrow/python/build/temp.linux-x86_64-3.6/lib.cxx:7124)()

ArrowNotImplementedError: NotImplemented: null
{code}
The versions are:
{code}
pandas: '0.19.2'
arrow: '0.4.0'
{code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)