[jira] [Closed] (SEDONA-14) Saving dataframe to CSV or Parquet fails due to unknown type

["Jia Yu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SEDONA-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jia Yu closed SEDONA-14.
------------------------

> Saving dataframe to CSV or Parquet fails due to unknown type
> ------------------------------------------------------------
>
>                 Key: SEDONA-14
>                 URL: https://issues.apache.org/jira/browse/SEDONA-14
>             Project: Apache Sedona
>          Issue Type: Bug
>    Affects Versions: 1.0.0
>            Reporter: Hugh Saalmans
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.0.1
>
>         Attachments: csv_save_error.txt, parquet_save_error.txt, test_save_df_issue.py
>
>
> Tested on Pyspark 3.0.1 (Python 3.8.6) with Sedona 1.0.0 RC1 on a Macbook Pro (Big Sur) and Pyspark 3.0.1 (Python 3.7.9) with Sedona 1.0.0 RC1 on AWS EMR 6.2.0.
> After adding a point geometry field to a dataframe, I'm unable to save the new dataframe. Saving to CSV returns a Python error (attached); whilst saving to Parquet returns the Java stack trace attached:
> Test file also attached.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)