You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Ángel <an...@gmail.com> on 2024/12/30 05:26:25 UTC

Re: spark TLS connection to hive metastore

I've just added a comment to this issue.

https://issues.apache.org/jira/browse/SPARK-49910


El vie, 4 oct 2024 a las 17:34, Stefano Bovina (<bo...@gmail.com>)
escribió:

> Hi,
> we are trying to configure an integration between trino, spark and hive
> metastore (HMS) in a secure way.
>
> Hive metastore has already been configured in order to use kerberos and
> TLS.
> Trino has already been configured in order to connect to HMS using TLS and
> kerberos.
>
> Trying to do the same for spark (connect it to HMS using TLS and kerberos)
> we faced a problem with TLS connection: if we configure spark using
> kerberos and plain connection to HMS (reconfiguring HMS too) it works, but
> if we enable TLS on both, spark is not able to connect.
>
> The error on HMS is the following: "Caused by: javax.net.ssl.SSLException:
> Unsupported or unrecognized SSL message" and indeed connections initiated
> by spark are alway plain.
>
> spark: 3.5.2_scala2.12
> hadoop: 3.3.6
> iceberg: 1.6.0
> hive: 4.0.0
>
> spark conf:
> https://gist.github.com/bovy89/83cbe3b9cd7a318fa9fd35355d5801fc
>
> Any ideas?
>