CSV DStream to Hive

[nimrodo <ni...@veracity-group.com>]

Hi all,

I have a DStream that contains very long comma separated values. I want to
convert this DStream to a DataFrame. I thought of using split on the RDD and
toDF however I can't get it to work.

Can anyone help me here?

Nimrod





--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/CSV-DStream-to-Hive-tp28410.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org

Re: CSV DStream to Hive

[ayan guha <gu...@gmail.com>]

I am afraid your requirement is not very clear. Can you post some example
data and what output are you expecting?


On Wed, 22 Feb 2017 at 9:13 am, nimrodo <ni...@veracity-group.com>
wrote:

> Hi all,
>
> I have a DStream that contains very long comma separated values. I want to
> convert this DStream to a DataFrame. I thought of using split on the RDD
> and
> toDF however I can't get it to work.
>
> Can anyone help me here?
>
> Nimrod
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/CSV-DStream-to-Hive-tp28410.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
> --
Best Regards,
Ayan Guha