You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "hong dongdong (JIRA)" <ji...@apache.org> on 2019/08/12 01:29:00 UTC
[jira] [Updated] (SPARK-28691) Examples of streaming support kafka
with kerberos
[ https://issues.apache.org/jira/browse/SPARK-28691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
hong dongdong updated SPARK-28691:
----------------------------------
Description:
Now, DirectKafkaWordCount example is not support to visit kafka using kerberos authentication. Add a parameter which target if kerberos is used.
{code:java}
Example:
kerberosOn: false(default)
$ bin/run-example streaming.DirectKafkaWordCount broker1-host:port,broker2-host:port \
consumer-group topic1,topic2
kerberosOn: true
$ bin/run-example --files ${path}/kafka_jaas.conf \
--driver-java-options "-Djava.security.auth.login.config=${path}/kafka_jaas.conf" \
--conf "spark.executor.extraJavaOptions=-Djava.security.auth.login.config=./kafka_jaas.conf" \
streaming.DirectKafkaWordCount broker1-host:port,broker2-host:port \
consumer-group topic1,topic2 true
{code}
was:Now, DirectKafkaWordCount example is not support to visit kafka using kerberos authentication. Add a parameter which target if kerberos is used.
> Examples of streaming support kafka with kerberos
> -------------------------------------------------
>
> Key: SPARK-28691
> URL: https://issues.apache.org/jira/browse/SPARK-28691
> Project: Spark
> Issue Type: Improvement
> Components: Examples
> Affects Versions: 3.0.0
> Reporter: hong dongdong
> Priority: Minor
>
> Now, DirectKafkaWordCount example is not support to visit kafka using kerberos authentication. Add a parameter which target if kerberos is used.
>
> {code:java}
> Example:
> kerberosOn: false(default)
> $ bin/run-example streaming.DirectKafkaWordCount broker1-host:port,broker2-host:port \
> consumer-group topic1,topic2
> kerberosOn: true
> $ bin/run-example --files ${path}/kafka_jaas.conf \
> --driver-java-options "-Djava.security.auth.login.config=${path}/kafka_jaas.conf" \
> --conf "spark.executor.extraJavaOptions=-Djava.security.auth.login.config=./kafka_jaas.conf" \
> streaming.DirectKafkaWordCount broker1-host:port,broker2-host:port \
> consumer-group topic1,topic2 true
> {code}
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org