You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@beam.apache.org by Jeff Zhang <zj...@gmail.com> on 2023/07/12 02:57:54 UTC

Does beam spark runner support yarn-cluster mode

Hi all,

I didn't find much material about spark runner, just wondering whether beam
spark runner support yarn-cluster mode. Thanks.


-- 
Best Regards

Jeff Zhang

Re: Does beam spark runner support yarn-cluster mode

Posted by Kai Jiang <ji...@gmail.com>.

Yeah, I think you could check this document out.
https://beam.apache.org/documentation/runners/spark/#running-on-dataproc-cluster-yarn-backed
Spark runner shall support running on yarn-cluster mode.

On Tue, Jul 11, 2023 at 7:58 PM Jeff Zhang <zj...@gmail.com> wrote:

> Hi all,
>
> I didn't find much material about spark runner, just wondering
> whether beam spark runner support yarn-cluster mode. Thanks.
>
>
> --
> Best Regards
>
> Jeff Zhang
>