[jira] [Commented] (SPARK-27742) Security Support in Sources and Sinks for SS and Batch

["Gabor Somogyi (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-27742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16841332#comment-16841332 ] 

Gabor Somogyi commented on SPARK-27742:
---------------------------------------

Kafka delegation token support just added to 3.0 on source and sink side as well. There Kerberos + SSL also supported.
Since I'm involved in streaming happy to be part of this effort (though not sure how much to be done).


> Security Support in Sources and Sinks for SS and Batch
> ------------------------------------------------------
>
>                 Key: SPARK-27742
>                 URL: https://issues.apache.org/jira/browse/SPARK-27742
>             Project: Spark
>          Issue Type: Brainstorming
>          Components: SQL, Structured Streaming
>    Affects Versions: 3.0.0
>            Reporter: Stavros Kontopoulos
>            Priority: Major
>
> As discussed with [~erikerlandson] on the [Big Data on K8s UG|https://docs.google.com/document/d/1pnF38NF6N5eM8DlK088XUW85Vms4V2uTsGZvSp8MNIA] it would be good to capture current status and identify work that needs to be done for securing Spark when accessing sources and sinks. For example what is the status of SSL, Kerberos support in different scenarios. The big concern nowadays is how to secure data pipelines end-to-end. 
> Note: Not sure if this overlaps with some other ticket. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org