[jira] [Resolved] (SPARK-26455) Spark Kinesis Integration with no SSL

["Hyukjin Kwon (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-26455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-26455.
----------------------------------
    Resolution: Invalid

If it's asking for help, let's do that in Spark mailing list. We can discuss and investigate further before filing an issue here. You could have better answer there.

> Spark Kinesis Integration with no SSL
> -------------------------------------
>
>                 Key: SPARK-26455
>                 URL: https://issues.apache.org/jira/browse/SPARK-26455
>             Project: Spark
>          Issue Type: Bug
>          Components: Spark Submit
>    Affects Versions: 2.3.0
>            Reporter: Shashikant Bangera
>            Priority: Major
>
> Hi, 
> we are trying access the endpoint thought library mentioned below and we get the SSL error i think internally it use KCL library. if you look at the error, so if I have to skip the certificate is it possible through KCL utils call ? because I do not find any provision to do that with set SSL as false within spark streaming kinesis library like we do with KCL. Can you please help me with the same.
> compile("org.apache.spark:spark-streaming-kinesis-asl_2.11:2.3.0") {
>  exclude group: 'org.apache.spark', module: 'spark-streaming_2.11'
> }
> Caused by: javax.net.ssl.SSLPeerUnverifiedException: Certificate for kinesis-endpoint> doesn't match any of the subject alternative names: [kinesis-fips.us-east-1.amazonaws.com, *.kinesis.us-east-1.vpce.amazonaws.com, kinesis.us-east-1.amazonaws.com]
>  at org.apache.http.conn.ssl.SSLConnectionSocketFactory.verifyHostname(SSLConnectionSocketFactory.java:467)
>  at org.apache.http.conn.ssl.SSLConnectionSocketFactory.createLayeredSocket(SSLConnectionSocketFactory.java:397)
>  at org.apache.http.conn.ssl.SSLConnectionSocketFactory.connectSocket(SSLConnectionSocketFactory.java:355)
>  at shade.com.amazonaws.http.conn.ssl.SdkTLSSocketFactory.connectSocket(SdkTLSSocketFactory.java:132)
>  at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:142)
>  at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:373)
>  at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
>  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at shade.com.amazonaws.http.conn.ClientConnectionManagerFactory$Handler.invoke(ClientConnectionManagerFactory.java:76)
>  at shade.com.amazonaws.http.conn.$Proxy18.connect(Unknown Source)
>  at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:381)
>  at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:237)
>  at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
>  at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
>  at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
>  at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
>  at shade.com.amazonaws.http.apache.client.impl.SdkHttpClient.execute(SdkHttpClient.java:72)
>  at shade.com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1238)
>  at shade.com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1058)
>  ... 20 more



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org