You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Kyle Weaver (Jira)" <ji...@apache.org> on 2021/06/01 19:21:00 UTC

[jira] [Commented] (BEAM-10877) Python SparkRunner should connect to secure cluster

    [ https://issues.apache.org/jira/browse/BEAM-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17355305#comment-17355305 ] 

Kyle Weaver commented on BEAM-10877:
------------------------------------

Note that this isn't possible for the uber jar job server. The uber jar job server uses the Spark REST API, which does not support authentication.

> Python SparkRunner should connect to secure cluster
> ---------------------------------------------------
>
>                 Key: BEAM-10877
>                 URL: https://issues.apache.org/jira/browse/BEAM-10877
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-spark
>            Reporter: Kyle Weaver
>            Priority: P3
>              Labels: portability-spark
>
> Currently, there is no way for the Python SparkRunner to connect to a secure Spark cluster. There should be.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)