You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Chethan <ch...@gmail.com> on 2018/07/18 18:23:00 UTC

Spark (Scala) Streaming [Convert rdd [org.bson.document] - > dataframe]

Hi Dev,

I am streaming from mongoDB using Kafka with spark streaming, It returns me
document [org.bson.document] . I wan to convert this rdd to dataframe to
process with other data.

Any suggestions will be helpful.


Thanks,
Chethan.

Re: Spark (Scala) Streaming [Convert rdd [org.bson.document] - > dataframe]

Posted by vincent gromakowski <vi...@gmail.com>.

Mongo libs provide a way to convert to case class

On Wed 18 Jul 2018 at 20:23, Chethan <ch...@gmail.com> wrote:

> Hi Dev,
>
> I am streaming from mongoDB using Kafka with spark streaming, It returns
> me document [org.bson.document] . I wan to convert this rdd to dataframe
> to process with other data.
>
> Any suggestions will be helpful.
>
>
> Thanks,
> Chethan.
>