[jira] [Created] (SPARK-22578) CSV with quoted line breaks not correctly parsed

["Carlos Barahona (JIRA)" <ji...@apache.org>]

Carlos Barahona created SPARK-22578:
---------------------------------------

             Summary: CSV with quoted line breaks not correctly parsed
                 Key: SPARK-22578
                 URL: https://issues.apache.org/jira/browse/SPARK-22578
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.2.0
            Reporter: Carlos Barahona


I believe the behavior addressed in SPARK-19610 still exists. Using spark 2.2.0, when attempting to read in a CSV file containing a quoted newline, the resulting dataset contains two separate items split along the quoted newline.

Example text:


{code:java}
4/28/2015 8:01,4/28/2015 8:19,0,100,1078,1,4/28/2015 8:19,email,"Hello

World", 2,3,4,5
{code}

scala> val csvFile = spark.read.csv("file:///path")
csvFile: org.apache.spark.sql.DataFrame = [_c0: string, _c1: string ... 7 more fields]

scala> csvFile.first()
res2: org.apache.spark.sql.Row = [4/28/2015 8:01,4/28/2015 8:19,0,100,1078,1,4/28/2015 8:19,email,Hello]

scala> csvFile.count()
res3: Long = 2





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org