Spark CSV output

[KhajaAsmath Mohammed <md...@gmail.com>]

Hi,

I am using the package com.databricks.spark.csv to save the dataframe
output to hdfs path. I am able to write the output but there are quotations
before and after end of the string. Did anyone resolve it when usinig it
with com.databricks.spark.csv package.

"An account was successfully logged on.|NULL SID|-|-|0x0"

Here is sample output that I got with quotations.

Thanks,
Asmath.

Re: Spark CSV output

[Hyukjin Kwon <gu...@gmail.com>]

Have you tried the quote related options (e.g. `quote` or `quoteMode`
*https://github.com/databricks/spark-csv/blob/master/README.md#features
<https://github.com/databricks/spark-csv/blob/master/README.md#features>)*?

On 11 Sep 2016 12:22 a.m., "ayan guha" <gu...@gmail.com> wrote:

> CSV standard uses quote to identify multiline output
> On 11 Sep 2016 01:04, "KhajaAsmath Mohammed" <md...@gmail.com>
> wrote:
>
>> Hi,
>>
>> I am using the package com.databricks.spark.csv to save the dataframe
>> output to hdfs path. I am able to write the output but there are quotations
>> before and after end of the string. Did anyone resolve it when usinig it
>> with com.databricks.spark.csv package.
>>
>> "An account was successfully logged on.|NULL SID|-|-|0x0"
>>
>> Here is sample output that I got with quotations.
>>
>> Thanks,
>> Asmath.
>>
>

Re: Spark CSV output

[ayan guha <gu...@gmail.com>]

CSV standard uses quote to identify multiline output
On 11 Sep 2016 01:04, "KhajaAsmath Mohammed" <md...@gmail.com>
wrote:

> Hi,
>
> I am using the package com.databricks.spark.csv to save the dataframe
> output to hdfs path. I am able to write the output but there are quotations
> before and after end of the string. Did anyone resolve it when usinig it
> with com.databricks.spark.csv package.
>
> "An account was successfully logged on.|NULL SID|-|-|0x0"
>
> Here is sample output that I got with quotations.
>
> Thanks,
> Asmath.
>