You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by "aka.fe2s" <ak...@gmail.com> on 2019/11/05 20:23:54 UTC

static dataframe to streaming

Hi All,

What is the most efficient way of converting static dataframe to streaming
(structured streaming)?
I have a custom sink implemented for structured streaming and I would like
to use it to write a static dataframe.
I know that I can write a dataframe to files and then source them to a
create a stream. Is there any more efficient way to do this?

--
Oleksiy