You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Eric Ho <er...@analyticsmd.com> on 2016/08/31 07:03:42 UTC
Spark to Kafka communication encrypted ?
I can't find in Spark 1.6.2's docs in how to turn encryption on for Spark
to Kafka communication ... I think that the Spark docs only tells you how
to turn on encryption for inter Spark node communications .. Am I wrong ?
Thanks.
--
-eric ho
Re: Spark to Kafka communication encrypted ?
Posted by Luciano Resende <lu...@gmail.com>.
I believe the encryption section should be updated now that a bunch of
related jiras were fixed yerterday such as
https://issues.apache.org/jira/browse/SPARK-5682
On Wed, Aug 31, 2016 at 9:46 AM, Cody Koeninger <co...@koeninger.org> wrote:
> http://spark.apache.org/docs/latest/security.html
>
> On Wed, Aug 31, 2016 at 11:15 AM, Mihai Iacob <mi...@ca.ibm.com> wrote:
>
>> Does Spark support encryption for inter node communication ?
>>
>>
>> Regards,
>>
>> *Mihai Iacob*
>> Next Generation Platform - Security
>> IBM Analytics
>>
>>
>> ------------------------------
>> Phone: 1-905-413-5378
>> E-mail: miacob@ca.ibm.com
>> Chat:[image: Sametime:] miacob@ca.ibm.com [image: Skype:] mihai-iacob
>> Find me on: [image: LinkedIn: https://ca.linkedin.com/in/iacobmihai]
>> <https://ca.linkedin.com/in/iacobmihai> [image: Twitter:
>> https://twitter.com/miacobv] <https://twitter.com/miacobv> and within
>> IBM on: [image: IBM Connections:
>> https://w3-connections.ibm.com/profiles/html/myProfileView.do]
>> <https://w3-connections.ibm.com/profiles/html/myProfileView.do> 8200
>> Warden Ave
>> Markham, ON L6G 1C7
>> Canada
>>
>>
>>
>> ----- Original message -----
>> From: Cody Koeninger <co...@koeninger.org>
>> To: Eric Ho <er...@analyticsmd.com>
>> Cc: "user@spark.apache.org" <us...@spark.apache.org>
>> Subject: Re: Spark to Kafka communication encrypted ?
>> Date: Wed, Aug 31, 2016 10:34 AM
>>
>> Encryption is only available in spark-streaming-kafka-0-10, not 0-8.
>> You enable it the same way you enable it for the Kafka project's new
>> consumer, by setting kafka configuration parameters appropriately.
>> http://kafka.apache.org/documentation.html#security_ssl
>>
>> On Wed, Aug 31, 2016 at 2:03 AM, Eric Ho <er...@analyticsmd.com> wrote:
>> > I can't find in Spark 1.6.2's docs in how to turn encryption on for
>> Spark to
>> > Kafka communication ... I think that the Spark docs only tells you how
>> to
>> > turn on encryption for inter Spark node communications .. Am I wrong ?
>> >
>> > Thanks.
>> >
>> > --
>> >
>> > -eric ho
>> >
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>>
>>
>>
>>
>
--
Luciano Resende
http://twitter.com/lresende1975
http://lresende.blogspot.com/
Re: Spark to Kafka communication encrypted ?
Posted by Cody Koeninger <co...@koeninger.org>.
http://spark.apache.org/docs/latest/security.html
On Wed, Aug 31, 2016 at 11:15 AM, Mihai Iacob <mi...@ca.ibm.com> wrote:
> Does Spark support encryption for inter node communication ?
>
>
> Regards,
>
> *Mihai Iacob*
> Next Generation Platform - Security
> IBM Analytics
>
>
> ------------------------------
> Phone: 1-905-413-5378
> E-mail: miacob@ca.ibm.com
> Chat:[image: Sametime:] miacob@ca.ibm.com [image: Skype:] mihai-iacob
> Find me on: [image: LinkedIn: https://ca.linkedin.com/in/iacobmihai]
> <https://ca.linkedin.com/in/iacobmihai> [image: Twitter:
> https://twitter.com/miacobv] <https://twitter.com/miacobv> and within
> IBM on: [image: IBM Connections:
> https://w3-connections.ibm.com/profiles/html/myProfileView.do]
> <https://w3-connections.ibm.com/profiles/html/myProfileView.do> 8200
> Warden Ave
> Markham, ON L6G 1C7
> Canada
>
>
>
> ----- Original message -----
> From: Cody Koeninger <co...@koeninger.org>
> To: Eric Ho <er...@analyticsmd.com>
> Cc: "user@spark.apache.org" <us...@spark.apache.org>
> Subject: Re: Spark to Kafka communication encrypted ?
> Date: Wed, Aug 31, 2016 10:34 AM
>
> Encryption is only available in spark-streaming-kafka-0-10, not 0-8.
> You enable it the same way you enable it for the Kafka project's new
> consumer, by setting kafka configuration parameters appropriately.
> http://kafka.apache.org/documentation.html#security_ssl
>
> On Wed, Aug 31, 2016 at 2:03 AM, Eric Ho <er...@analyticsmd.com> wrote:
> > I can't find in Spark 1.6.2's docs in how to turn encryption on for
> Spark to
> > Kafka communication ... I think that the Spark docs only tells you how
> to
> > turn on encryption for inter Spark node communications .. Am I wrong ?
> >
> > Thanks.
> >
> > --
> >
> > -eric ho
> >
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
>
>
>
>
Re: Spark to Kafka communication encrypted ?
Posted by Cody Koeninger <co...@koeninger.org>.
Encryption is only available in spark-streaming-kafka-0-10, not 0-8.
You enable it the same way you enable it for the Kafka project's new
consumer, by setting kafka configuration parameters appropriately.
http://kafka.apache.org/documentation.html#security_ssl
On Wed, Aug 31, 2016 at 2:03 AM, Eric Ho <er...@analyticsmd.com> wrote:
> I can't find in Spark 1.6.2's docs in how to turn encryption on for Spark to
> Kafka communication ... I think that the Spark docs only tells you how to
> turn on encryption for inter Spark node communications .. Am I wrong ?
>
> Thanks.
>
> --
>
> -eric ho
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org