You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sedona.apache.org by "Hugh Saalmans (Jira)" <ji...@apache.org> on 2021/01/29 04:15:00 UTC

[jira] [Created] (SEDONA-14) Saving dataframe to CSV or Parquet fails due to unknown type

Hugh Saalmans created SEDONA-14:
-----------------------------------

             Summary: Saving dataframe to CSV or Parquet fails due to unknown type
                 Key: SEDONA-14
                 URL: https://issues.apache.org/jira/browse/SEDONA-14
             Project: Apache Sedona
          Issue Type: Bug
            Reporter: Hugh Saalmans
         Attachments: csv_save_error.txt, parquet_save_error.txt, test_save_df_issue.py

Tested on Pyspark 3.0.1 (Python 3.8.6) with Sedona 1.0.0 RC1 on both a Macbook Pro (Big Sur) and Pyspark 3.0.1 (Python 3.7.9) with Sedona 1.0.0 RC1 on AWS EMR 6.2.0.

After adding a point geometry field to a dataframe, I'm unable to save the new dataframe. Saving to CSV returns a Python error (attached); whilst saving to Parquet returns the Java stack trace attached:

Test file also attached.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)