You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Attila Doroszlai (Jira)" <ji...@apache.org> on 2022/04/21 19:08:00 UTC
[jira] [Comment Edited] (HDDS-6626) Exclude Hadoop Thirdparty from shaded Ozone FS jars
[ https://issues.apache.org/jira/browse/HDDS-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525994#comment-17525994 ]
Attila Doroszlai edited comment on HDDS-6626 at 4/21/22 7:07 PM:
-----------------------------------------------------------------
BTW, the root cause is that HDDS-5431 added explicit dependency on hadoop-shaded-protobuf for Ozone. This then leaks into the fat jar. Reproducible with [aa4f969188|https://github.com/apache/ozone/commit/aa4f969188], but not with the prior commit.
{code}
[INFO] org.apache.ozone:ozone-filesystem-hadoop3:jar:1.2.0-SNAPSHOT
...
[INFO] +- org.apache.hadoop:hadoop-common:jar:3.3.1:provided
[INFO] | +- org.apache.hadoop.thirdparty:hadoop-shaded-protobuf_3_7:jar:1.1.1:compile
[INFO] | +- org.apache.hadoop.thirdparty:hadoop-shaded-guava:jar:1.1.1:provided
{code}
was (Author: adoroszlai):
BTW, the root cause is that HDDS-5431 added explicit dependency on hadoop-shaded-protobuf for Ozone. This then leaks into the fat jar. Reproducible with [aa4f969188|https://github.com/apache/ozone/commit/aa4f969188], but not with the prior commit.
> Exclude Hadoop Thirdparty from shaded Ozone FS jars
> ---------------------------------------------------
>
> Key: HDDS-6626
> URL: https://issues.apache.org/jira/browse/HDDS-6626
> Project: Apache Ozone
> Issue Type: Bug
> Components: build, Ozone Filesystem
> Affects Versions: 1.2.0
> Reporter: Attila Doroszlai
> Assignee: Attila Doroszlai
> Priority: Major
> Labels: pull-request-available
>
> Shaded Ozone FS jars currently include Hadoop Thirdparty libs. This can result in version mismatch if the FS jars are used with different Hadoop version than the one we package with (3.3.1 currently). Hadoop Thirdparty libs should be excluded and provided by the user, similar to regular Hadoop libs (hadoop-common, hadoop-hdfs-client, etc.).
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org