You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@beam.apache.org by Meriem Sara <Sa...@outlook.fr> on 2020/11/21 22:57:00 UTC

is apache beam go sdk supported by spark runner?

Hello everyone. I am trying to use apache beam with Golang to execute a data processing workflow using apache Spark.  However, I am confused if the go SDK is supported by apache Spark. Could you please provide us wirh more information ?

Thank you

Re: is apache beam go sdk supported by spark runner?

Posted by Robert Bradshaw <ro...@google.com>.

Yes, it should be for batch (just like for Python). There is ongoing
work to make it work for Streaming as well.

On Sat, Nov 21, 2020 at 2:57 PM Meriem Sara <Sa...@outlook.fr> wrote:
>
> Hello everyone. I am trying to use apache beam with Golang to execute a data processing workflow using apache Spark.  However, I am confused if the go SDK is supported by apache Spark. Could you please provide us wirh more information ?
>
> Thank you