You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by pooja-murarka <gi...@git.apache.org> on 2018/12/04 01:11:06 UTC
[GitHub] spark issue #23080: [SPARK-26108][SQL] Support custom lineSep in CSV datasou...
Github user pooja-murarka commented on the issue:
https://github.com/apache/spark/pull/23080
I am testing **lineSep** with spark 2.4
data.csv : "a",1 "c",2 "d",3
val schema : StructType =
StructType(
Seq(
StructField(name = "dteday", dataType = StringType),
StructField(name = "hr", dataType = IntegerType)
)
_val logData = spark.read.format("csv").schema(schema).option("lineSep", "\t").load("data.csv")_
But can only see schema without any data.
scala> logData.show()
+------+----+
|dteday| hr|
+------+----+
| null|null|
+------+----+
Can you please suggest if i missed something or above fix has not been merged with branch.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org