You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Sean Roberts (JIRA)" <ji...@apache.org> on 2019/01/09 15:17:00 UTC

[jira] [Created] (AMBARI-25093) "Spark2 Thrift Server" alert does not work with HTTPS (SSL)

Sean Roberts created AMBARI-25093:
-------------------------------------

             Summary: "Spark2 Thrift Server" alert does not work with HTTPS (SSL)
                 Key: AMBARI-25093
                 URL: https://issues.apache.org/jira/browse/AMBARI-25093
             Project: Ambari
          Issue Type: Bug
          Components: alerts
    Affects Versions: 2.6.0, 2.7.0, 2.7.1, 2.7.3
            Reporter: Sean Roberts


With HTTPS enabled for Spark2 Thrift, the Ambari alerts fail with:
{code}
Connection failed on host hdpmasterp01.hwp.int.domain.com:10016 (Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SPARK2/package/scripts/alerts/alert_spark2_thrift_port.py", line 147, in execute
 ...
ExecutionFailed: Execution of '! /usr/hdp/current/spark2-client/bin/beeline -u 'jdbc:hive2://hdpmasterp01.hwp.int.domain.com:10016/default;principal=spark/hdpmasterp01.hwp.int.domain.com@HWP.INT.DOMAIN.COM;transportMode=http'  -e '' 2>&1| awk '{print}'|grep -i -e 'Connection refused' -e 'Invalid URL' -e 'Error: Could not open'' returned 1. Error: Could not open client transport with JDBC Uri: jdbc:hive2://hdpmasterp01.hwp.int.domain.com:10016/default;principal=spark/hdpmasterp01.hwp.int.domain.com@HWP.INT.DOMAIN.COM;transportMode=http: Could not create http connection to jdbc:hive2://hdpmasterp01.hwp.int.domain.com:10016/default;principal=spark/hdpmasterp01.hwp.int.domain.com@HWP.INT.DOMAIN.COM;transportMode=http. org.apache.http.client.ClientProtocolException (state=08S01,code=0)
Error: Could not open client transport with JDBC Uri: jdbc:hive2://hdpmasterp01.hwp.int.domain.com:10016/default;principal=spark/hdpmasterp01.hwp.int.domain.com@HWP.INT.DOMAIN.COM;transportMode=http: Could not create http connection to jdbc:hive2://hdpmasterp01.hwp.int.domain.com:10016/default;principal=spark/hdpmasterp01.hwp.int.domain.com@HWP.INT.DOMAIN.COM;transportMode=http. org.apache.http.client.ClientProtocolException (state=08S01,code=0)
{code}

When HTTPS is enabled, the alert scripts should add `;ssl=true;httpPath=cliservice` as I have below:
{code}
$ /usr/hdp/current/spark2-client/bin/beeline -u 'jdbc:hive2://hdpmasterp01.hwp.int.domain.com:10016/default;principal=spark/hdpmasterp01.hwp.int.domain.com@HWP.INT.DOMAIN.COM;transportMode=http;ssl=true;httpPath=cliservice'
Connecting to jdbc:hive2://hdpmasterp01.hwp.int.domain.com:10016/default;principal=spark/hdpmasterp01.hwp.int.domain.com@HWP.INT.DOMAIN.COM;transportMode=http;ssl=true;httpPath=cliservice
...
Connected to: Spark SQL (version 2.3.2.3.1.0.0-78)
Driver: Hive JDBC (version 1.21.2.3.1.0.0-78)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Beeline version 1.21.2.3.1.0.0-78 by Apache Hive
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)