You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@sedona.apache.org by "Hugh Saalmans (Jira)" <ji...@apache.org> on 2021/01/29 04:15:00 UTC
[jira] [Created] (SEDONA-14) Saving dataframe to CSV or Parquet
fails due to unknown type
Hugh Saalmans created SEDONA-14:
-----------------------------------
Summary: Saving dataframe to CSV or Parquet fails due to unknown type
Key: SEDONA-14
URL: https://issues.apache.org/jira/browse/SEDONA-14
Project: Apache Sedona
Issue Type: Bug
Reporter: Hugh Saalmans
Attachments: csv_save_error.txt, parquet_save_error.txt, test_save_df_issue.py
Tested on Pyspark 3.0.1 (Python 3.8.6) with Sedona 1.0.0 RC1 on both a Macbook Pro (Big Sur) and Pyspark 3.0.1 (Python 3.7.9) with Sedona 1.0.0 RC1 on AWS EMR 6.2.0.
After adding a point geometry field to a dataframe, I'm unable to save the new dataframe. Saving to CSV returns a Python error (attached); whilst saving to Parquet returns the Java stack trace attached:
Test file also attached.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)