You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Mario Molina (JIRA)" <ji...@apache.org> on 2018/08/25 17:39:00 UTC

[jira] [Created] (SPARK-25241) Configurable empty values when reading/writing CSV files

Mario Molina created SPARK-25241:
------------------------------------

             Summary: Configurable empty values when reading/writing CSV files
                 Key: SPARK-25241
                 URL: https://issues.apache.org/jira/browse/SPARK-25241
             Project: Spark
          Issue Type: Improvement
          Components: Input/Output
    Affects Versions: 2.3.1, 2.4.0
            Reporter: Mario Molina


There is an option in the CSV parser to set values when we have empty values in the CSV files or in our dataframes.

Currently, this option cannot be configured and always sets a default value (empty string for reading and `""` for writing).

I think it'd be interesting to enable this option in the CSV reader/writer to allow customizing these empty values.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org