You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "Masatake Iwasaki (Jira)" <ji...@apache.org> on 2022/06/19 18:43:00 UTC

[jira] [Comment Edited] (BIGTOP-3706) Bump Hadoop to 3.3.3

    [ https://issues.apache.org/jira/browse/BIGTOP-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556112#comment-17556112 ] 

Masatake Iwasaki edited comment on BIGTOP-3706 at 6/19/22 6:42 PM:
-------------------------------------------------------------------

Building Hadoop fails if jars of ZooKeeper built by Bigtop exists in local repository (~/.m2/repository).

{noformat}
$ ./gradlew zookeeper-pkg hadoop-pkg
...
[ERROR] Found artifact with unexpected contents: '/home/rocky/srcs/bigtop/build/hadoop/rpm/BUILD/hadoop-3.3.3-src/hadoop-client-modules/hadoop-client-minicluster/target/hadoop-client-minicluster-3.3.3.jar'
    Please check the following and either correct the build or update
    the allowed list with reasoning.

    edu/
    edu/umd/
    edu/umd/cs/
    edu/umd/cs/findbugs/
    edu/umd/cs/findbugs/annotations/
    edu/umd/cs/findbugs/annotations/NonNull.class
    edu/umd/cs/findbugs/annotations/CheckForNull.class
    edu/umd/cs/findbugs/annotations/DefaultAnnotationForFields.class
    ...
{noformat}

Since this issue can be fixed by {{`rm -rf ~/.m2/repository/org/apache/zookeeper`}} before building Hadoop, ZooKeeper jar built by Bigtop looks containing unexpected classes which are not appear in jars pulled from public Maven repositories.

The patch of BIGTOP-3669 ([#890|https://github.com/apache/bigtop/pull/890]) fixes this issue.


was (Author: iwasakims):
Building Hadoop fails if jars of ZooKeeper built by Bigtop exists in local repository (~/.m2/repository).

{noformat}
$ ./gradlew zookeeper-pkg hadoop-pkg
...
[ERROR] Found artifact with unexpected contents: '/home/rocky/srcs/bigtop/build/hadoop/rpm/BUILD/hadoop-3.3.3-src/hadoop-client-modules/hadoop-client-minicluster/target/hadoop-client-minicluster-3.3.3.jar'
    Please check the following and either correct the build or update
    the allowed list with reasoning.

    edu/
    edu/umd/
    edu/umd/cs/
    edu/umd/cs/findbugs/
    edu/umd/cs/findbugs/annotations/
    edu/umd/cs/findbugs/annotations/NonNull.class
    edu/umd/cs/findbugs/annotations/CheckForNull.class
    edu/umd/cs/findbugs/annotations/DefaultAnnotationForFields.class
    ...
{noformat}

Since this issue can be fixed by rm -rf ~/.m2/repository/org/apache/zookeeper before building Hadoop, ZooKeeper jar built by Bigtop looks containing unexpected classes which are not appear in jars pulled from public Maven repositories.

The patch of BIGTOP-3669 ([#890|https://github.com/apache/bigtop/pull/890]) fixes this issue.

> Bump Hadoop to 3.3.3
> --------------------
>
>                 Key: BIGTOP-3706
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-3706
>             Project: Bigtop
>          Issue Type: Sub-task
>          Components: hadoop
>            Reporter: Masatake Iwasaki
>            Assignee: Masatake Iwasaki
>            Priority: Major
>          Time Spent: 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.20.7#820007)