[jira] [Commented] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build

["Steve Loughran (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531317#comment-17531317 ] 

Steve Loughran commented on HADOOP-18160:
-----------------------------------------

[~andre.amorimfonseca@gmail.com] can you grab the rc00 binaries from https://dist.apache.org/repos/dist/dev/hadoop/3.3.3-RC0/ , verify they work and provide feedback on the hadoop-common list? 

> `org.wildfly.openssl` should not be shaded by Hadoop build
> ----------------------------------------------------------
>
>                 Key: HADOOP-18160
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18160
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 3.3.1
>         Environment: hadoop 3.3.1
> spark 3.2.1
> JDK8
>            Reporter: André F.
>            Assignee: André F.
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 3.4.0, 3.3.3
>
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> `org.wildfly.openssl` is a runtime library and its references are being shaded on Hadoop, breaking the integration with other frameworks like Spark, whenever the "fs.s3a.ssl.channel.mode" is set to "openssl". The error produced in this situation is:
> {code:java}
> Suppressed: java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/org/wildfly/openssl/OpenSSLProvider{code}
> Whenever it tries to be instantiated from the `DelegatingSSLSocketFactory`. Spark tries to add it to its classpath without the shade, thus creating this issue.
> Dependencies which are not on "compile" scope should probably not be shaded to avoid this kind of integration issues.
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org