You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/02/02 03:58:00 UTC
[jira] [Commented] (SPARK-26804) Spark sql carries newline char
from last csv column when imported
[ https://issues.apache.org/jira/browse/SPARK-26804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16758872#comment-16758872 ]
Hyukjin Kwon commented on SPARK-26804:
--------------------------------------
Can you show your input file? It would be easier to verify the issue if there's a self-contained reproducer. I am leaving this JIRA resolved until the details are provided.
> Spark sql carries newline char from last csv column when imported
> -----------------------------------------------------------------
>
> Key: SPARK-26804
> URL: https://issues.apache.org/jira/browse/SPARK-26804
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.4.0
> Reporter: Raj
> Priority: Major
>
> I am trying to generate external sql tables in DataBricks using Spark sql query. Below is my query. The query reads csv file and creates external table but it carries the newline char while creating the last column. Is there a way to resolve this issue?
>
> %sql
> create table if not exists <<My table name>>
> using CSV
> options ("header"="true", "inferschema"="true","multiLine"="true", "escape"='"')
> location <my csv path>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org