You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Derek M Miller (JIRA)" <ji...@apache.org> on 2017/01/04 14:40:58 UTC

[jira] [Created] (SPARK-19079) Spark 1.6.1 SASL Error with Yarn

Derek M Miller created SPARK-19079:
--------------------------------------

             Summary: Spark 1.6.1 SASL Error with Yarn
                 Key: SPARK-19079
                 URL: https://issues.apache.org/jira/browse/SPARK-19079
             Project: Spark
          Issue Type: Bug
            Reporter: Derek M Miller


Currently, there seems to be an issue when using SASL in Spark with yarn with at least 1.6.1. I wrote up a stackoverflow issue with the exact details of my configuration here: http://stackoverflow.com/questions/41453588/spark-sasl-not-working-on-the-emr-with-yarn .

In short, I have added the spark.authenticate parameter to the hadoop and spark configuration. I also have these parameters as well.

```
      "spark.authenticate.enableSaslEncryption": "true",
      "spark.network.sasl.serverAlwaysEncrypt": "true"
```

However, I am consistently getting this error message:

```
java.lang.RuntimeException: java.lang.IllegalArgumentException: Unknown message type: -22
```

Further debugging has not been helpful. I think it is worth noting that this is all on Amazon's emr as well.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org