You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Steve Loughran (Jira)" <ji...@apache.org> on 2022/04/18 15:32:00 UTC

[jira] [Resolved] (HADOOP-18160) `org.wildfly.openssl` should not be shaded by Hadoop build

     [ https://issues.apache.org/jira/browse/HADOOP-18160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Steve Loughran resolved HADOOP-18160.
-------------------------------------
    Fix Version/s: 3.3.3
                       (was: 3.3.4)
       Resolution: Fixed

> `org.wildfly.openssl` should not be shaded by Hadoop build
> ----------------------------------------------------------
>
>                 Key: HADOOP-18160
>                 URL: https://issues.apache.org/jira/browse/HADOOP-18160
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: build
>    Affects Versions: 3.3.1
>         Environment: hadoop 3.3.1
> spark 3.2.1
> JDK8
>            Reporter: André F.
>            Assignee: André F.
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 3.3.3
>
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> `org.wildfly.openssl` is a runtime library and its references are being shaded on Hadoop, breaking the integration with other frameworks like Spark, whenever the "fs.s3a.ssl.channel.mode" is set to "openssl". The error produced in this situation is:
> {code:java}
> Suppressed: java.lang.NoClassDefFoundError: org/apache/hadoop/shaded/org/wildfly/openssl/OpenSSLProvider{code}
> Whenever it tries to be instantiated from the `DelegatingSSLSocketFactory`. Spark tries to add it to its classpath without the shade, thus creating this issue.
> Dependencies which are not on "compile" scope should probably not be shaded to avoid this kind of integration issues.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org