You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Marcelo Vanzin (Jira)" <ji...@apache.org> on 2019/09/09 22:43:00 UTC

[jira] [Resolved] (SPARK-28928) Use Kafka delegation token protocol on sources/sinks

     [ https://issues.apache.org/jira/browse/SPARK-28928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marcelo Vanzin resolved SPARK-28928.
------------------------------------
    Fix Version/s: 3.0.0
       Resolution: Fixed

Issue resolved by pull request 25631
[https://github.com/apache/spark/pull/25631]

> Use Kafka delegation token protocol on sources/sinks
> ----------------------------------------------------
>
>                 Key: SPARK-28928
>                 URL: https://issues.apache.org/jira/browse/SPARK-28928
>             Project: Spark
>          Issue Type: Improvement
>          Components: Structured Streaming
>    Affects Versions: 3.0.0
>            Reporter: Gabor Somogyi
>            Assignee: Gabor Somogyi
>            Priority: Major
>             Fix For: 3.0.0
>
>
> At the moment there are 3 places where communication protocol with Kafka cluster has to be configured:
>  * On delegation token
>  * On source
>  * On sink
> Most of the time users are using the same protocol on all these places (within one Kafka cluster). It would be better to declare it in one place (delegation token side) and Kafka sources/sinks can take this config over.
>  



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org