You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Derek M Miller (JIRA)" <ji...@apache.org> on 2017/01/04 14:40:58 UTC
[jira] [Created] (SPARK-19079) Spark 1.6.1 SASL Error with Yarn
Derek M Miller created SPARK-19079:
--------------------------------------
Summary: Spark 1.6.1 SASL Error with Yarn
Key: SPARK-19079
URL: https://issues.apache.org/jira/browse/SPARK-19079
Project: Spark
Issue Type: Bug
Reporter: Derek M Miller
Currently, there seems to be an issue when using SASL in Spark with yarn with at least 1.6.1. I wrote up a stackoverflow issue with the exact details of my configuration here: http://stackoverflow.com/questions/41453588/spark-sasl-not-working-on-the-emr-with-yarn .
In short, I have added the spark.authenticate parameter to the hadoop and spark configuration. I also have these parameters as well.
```
"spark.authenticate.enableSaslEncryption": "true",
"spark.network.sasl.serverAlwaysEncrypt": "true"
```
However, I am consistently getting this error message:
```
java.lang.RuntimeException: java.lang.IllegalArgumentException: Unknown message type: -22
```
Further debugging has not been helpful. I think it is worth noting that this is all on Amazon's emr as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org