You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Ruslan Dautkhanov <da...@gmail.com> on 2017/12/11 23:39:50 UTC
Re: zeppelin build fails with DependencyConvergence error
Looks like master branch of Zeppelin still has compatibility issue with
Cloudera dependencies.
When built using
mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1
-Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e
maven fails on jackson convergence error - see below email for more
details.
Looks like there was a change in Zeppelin that upgraded Jackson's version?
So now it conflicts with older jackson library as referenced by cloudera
repo.
workaround: Zeppelin builds fine with pom change [1] - the question is now
would somebody expect Zeppelin would still be functioning correctly with
these exclusions?
[1]
--- a/zeppelin-zengine/pom.xml
> +++ b/zeppelin-zengine/pom.xml
> @@ -364,6 +364,30 @@
> <groupId>com.google.guava</groupId>
> <artifactId>guava</artifactId>
> </exclusion>
> + <exclusion>
> + <groupId>com.fasterxml.jackson.core</groupId>
> + <artifactId>jackson-core</artifactId>
> + </exclusion>
> + <exclusion>
> + <groupId>com.fasterxml.jackson.core</groupId>
> + <artifactId>jackson-annotations</artifactId>
> + </exclusion>
> + <exclusion>
> + <groupId>com.fasterxml.jackson.core</groupId>
> + <artifactId>jackson-databind</artifactId>
> + </exclusion>
> + <exclusion>
> + <groupId>org.codehaus.jackson</groupId>
> + <artifactId>jackson-mapper-asl</artifactId>
> + </exclusion>
> + <exclusion>
> + <groupId>org.codehaus.jackson</groupId>
> + <artifactId>jackson-core-asl</artifactId>
> + </exclusion>
> + <exclusion>
> + <groupId>org.apache.zookeeper</groupId>
> + <artifactId>zookeeper</artifactId>
> + </exclusion>
> </exclusions>
> </dependency>
>
On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <da...@gmail.com>
wrote:
> Building from a current Zeppelin snapshot fails with
> zeppelin build fails with org.apache.maven.plugins.
> enforcer.DependencyConvergence
> see details below.
>
> Build command
> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10
> -Psparkr -pl '!*..excluded certain modules..*' -e
>
> maven 3.5.0
>> jdk 1.8.0_141
>> RHEL 7.3
>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7
>> nodejs.x86_64 1:6.11.1-1.el7 @epel
>> latest zeppelin snapshot
>
>
> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen this
> problem before.
>
> Thanks,
> Ruslan
>
>
>
> [INFO] Scanning for projects...
> [WARNING]
> [WARNING] Some problems were encountered while building the effective
> model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.
> 8.0-SNAPSHOT
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
> @ line 940, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
> @ line 997, column 15
> [WARNING]
> [WARNING] Some problems were encountered while building the effective
> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
> @ line 467, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
> @ line 475, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin org.apache.maven.plugins:maven-compiler-plugin
> @ line 486, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
> @ line 496, column 15
> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
> found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
> @ line 504, column 15
> [WARNING]
> [WARNING] It is highly recommended to fix these problems because they
> threaten the stability of your build.
> [WARNING]
> [WARNING] For this reason, future Maven versions might no longer support
> building such malformed projects.
> [WARNING]
> [WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT
> uses prerequisites which is only intended for maven-plugin projects but not
> for non maven-plugin projects. For such purposes you should use the
> maven-enforcer-plugin. See https://maven.apache.org/
> enforcer/enforcer-rules/requireMavenVersion.html
>
>
> ... [skip]
>
> [INFO] ------------------------------------------------------------
> ------------
> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
> [INFO] ------------------------------------------------------------
> ------------
> [INFO]
> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
> zeppelin-zengine ---
> [INFO]
> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
> zeppelin-zengine ---
> [INFO]
> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @
> zeppelin-zengine ---
> [INFO]
> [INFO]
> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @
> zeppelin-zengine ---
> [INFO] Using 'UTF-8' encoding to copy filtered resources.
> [INFO] Copying 17 resources
> [INFO]
> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @
> zeppelin-zengine ---
> [WARNING]
> Dependency convergence error for com.fasterxml.jackson.core:jackson-core:2.5.3
> paths to dependency are:
> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
> +-com.amazonaws:aws-java-sdk-s3:1.10.62
> +-com.amazonaws:aws-java-sdk-core:1.10.62
> +-com.fasterxml.jackson.core:jackson-databind:2.5.3
> +-com.fasterxml.jackson.core:jackson-core:2.5.3
> and
> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
> +-com.fasterxml.jackson.core:jackson-core:2.2.3
>
> [WARNING]
> Dependency convergence error for org.codehaus.jackson:jackson-mapper-asl:1.9.13
> paths to dependency are:
> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
> +-com.github.eirslett:frontend-maven-plugin:1.3
> +-com.github.eirslett:frontend-plugin-core:1.3
> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
> and
> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8
> and
> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>
> ... [skipped a number of other version convergence errors for dependencies]
>
>
>
Re: zeppelin build fails with DependencyConvergence error
Posted by Jeff Zhang <zj...@gmail.com>.
ZEPPELIN-3119 is merged, which will be included in 0.8.0
Ruslan Dautkhanov <da...@gmail.com>于2018年1月12日周五 上午12:35写道：
> Thank you Jeff
>
>
> --
> Ruslan Dautkhanov
>
> On Thu, Jan 11, 2018 at 1:57 AM, Jeff Zhang <zj...@gmail.com> wrote:
>
>>
>> ZEPPELIN-3119 will fix this. Will update this thread once it is done
>>
>>
>>
>>
>> Ruslan Dautkhanov <da...@gmail.com>于2017年12月29日周五 上午6:04写道：
>>
>>> The build failure messages all point to the zeppelin-zengine module in
>>> the source code. In this commit:
>>> https://github.com/apache/zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-98784f3ef76c2907324fa9e48e66cf47
>>> , a dependency change was made to add the org.apache.hadoop:hadoop-client
>>> which points to both org.apache.hadoop:hadoop-common and
>>> org.apache.hadoop:hadoop-hdfs. These two have dependencies upon different
>>> versions (at least for the Cloudera version of them) of the
>>> org.codehaus.jackson:jackson-mapper-asl library, 1.8.8 and 1.9.13
>>> respectively.
>>>
>>> Was anyone able to build zeppelin with cloudera repo after
>>> ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client
>>> jar) PR #2455
>>> was committed ?
>>>
>>>
>>> On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <dautkhanov@gmail.com
>>> > wrote:
>>>
>>>> We're now looking at shading option.
>>>>
>>>> Talking to Cloudera Support even minor upgrades to jackson known have
>>>> caused issues in the past.
>>>> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 -
>>>> but this will be released mid-next year.
>>>> So we're not waiting for that to happen.
>>>>
>>>> Yes, we will contribute back to the project when we find solution.
>>>> Thanks for the suggestion Felix. Is this known if Zeppelin can work
>>>> fine with jasckson 2.*2*.3?
>>>> (certain dependencies currently list jackson 2.*5*.3)
>>>>
>>>>
>>>>
>>>> --
>>>> Ruslan Dautkhanov
>>>>
>>>> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <
>>>> felixcheung_m@hotmail.com> wrote:
>>>>
>>>>> Instead of exclusion, would it be better to use the version in the
>>>>> cloudera repo?
>>>>>
>>>>> Please do consider contributing these changes back to Zeppelin source.
>>>>> Thanks!
>>>>>
>>>>> _____________________________
>>>>> From: Ruslan Dautkhanov <da...@gmail.com>
>>>>> Sent: Monday, December 11, 2017 3:42 PM
>>>>> Subject: Re: zeppelin build fails with DependencyConvergence error
>>>>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
>>>>>
>>>>>
>>>>>
>>>>> Looks like master branch of Zeppelin still has compatibility issue
>>>>> with Cloudera dependencies.
>>>>>
>>>>> When built using
>>>>>
>>>>> mvn clean package -DskipTests -Pspark-2.2
>>>>> -Dhadoop.version=2.6.0-cdh5.12.1 -Phadoop-2.6 -Pvendor-repo -pl '!...list
>>>>> of excluded packages' -e
>>>>>
>>>>> maven fails on jackson convergence error - see below email for more
>>>>> details.
>>>>> Looks like there was a change in Zeppelin that upgraded Jackson's
>>>>> version?
>>>>> So now it conflicts with older jackson library as referenced by
>>>>> cloudera repo.
>>>>>
>>>>> workaround: Zeppelin builds fine with pom change [1] - the question is
>>>>> now
>>>>> would somebody expect Zeppelin would still be functioning correctly
>>>>> with these exclusions?
>>>>>
>>>>>
>>>>>
>>>>> [1]
>>>>>
>>>>> --- a/zeppelin-zengine/pom.xml
>>>>>> +++ b/zeppelin-zengine/pom.xml
>>>>>> @@ -364,6 +364,30 @@
>>>>>> <groupId>com.google.guava</groupId>
>>>>>> <artifactId>guava</artifactId>
>>>>>> </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>>> + <artifactId>jackson-core</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>>> + <artifactId>jackson-annotations</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>>> + <artifactId>jackson-databind</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>org.codehaus.jackson</groupId>
>>>>>> + <artifactId>jackson-mapper-asl</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>org.codehaus.jackson</groupId>
>>>>>> + <artifactId>jackson-core-asl</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>org.apache.zookeeper</groupId>
>>>>>> + <artifactId>zookeeper</artifactId>
>>>>>> + </exclusion>
>>>>>> </exclusions>
>>>>>> </dependency>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <
>>>>> dautkhanov@gmail.com> wrote:
>>>>>
>>>>>> Building from a current Zeppelin snapshot fails with
>>>>>> zeppelin build fails with
>>>>>> org.apache.maven.plugins.enforcer.DependencyConvergence
>>>>>> see details below.
>>>>>>
>>>>>> Build command
>>>>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
>>>>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10
>>>>>> -Psparkr -pl '!*..excluded certain modules..*' -e
>>>>>>
>>>>>> maven 3.5.0
>>>>>>> jdk 1.8.0_141
>>>>>>> RHEL 7.3
>>>>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7
>>>>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel
>>>>>>> latest zeppelin snapshot
>>>>>>
>>>>>>
>>>>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen
>>>>>> this problem before.
>>>>>>
>>>>>> Thanks,
>>>>>> Ruslan
>>>>>>
>>>>>>
>>>>>>
>>>>>> [INFO] Scanning for projects...
>>>>>> [WARNING]
>>>>>> [WARNING] Some problems were encountered while building the effective
>>>>>> model for
>>>>>> org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8.0-SNAPSHOT
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 940,
>>>>>> column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 997,
>>>>>> column 15
>>>>>> [WARNING]
>>>>>> [WARNING] Some problems were encountered while building the effective
>>>>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.scala-tools:maven-scala-plugin @ line 467, column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 475, column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.apache.maven.plugins:maven-compiler-plugin @ line 486, column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.scala-tools:maven-scala-plugin @ line 496, column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 504, column 15
>>>>>> [WARNING]
>>>>>> [WARNING] It is highly recommended to fix these problems because they
>>>>>> threaten the stability of your build.
>>>>>> [WARNING]
>>>>>> [WARNING] For this reason, future Maven versions might no longer
>>>>>> support building such malformed projects.
>>>>>> [WARNING]
>>>>>> [WARNING] The project
>>>>>> org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT uses prerequisites
>>>>>> which is only intended for maven-plugin projects but not for non
>>>>>> maven-plugin projects. For such purposes you should use the
>>>>>> maven-enforcer-plugin. See
>>>>>> https://maven.apache.org/enforcer/enforcer-rules/requireMavenVersion.html
>>>>>>
>>>>>>
>>>>>> ... [skip]
>>>>>>
>>>>>> [INFO]
>>>>>> ------------------------------------------------------------------------
>>>>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
>>>>>> [INFO]
>>>>>> ------------------------------------------------------------------------
>>>>>> [INFO]
>>>>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
>>>>>> zeppelin-zengine ---
>>>>>> [INFO]
>>>>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
>>>>>> zeppelin-zengine ---
>>>>>> [INFO]
>>>>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build)
>>>>>> @ zeppelin-zengine ---
>>>>>> [INFO]
>>>>>> [INFO]
>>>>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources)
>>>>>> @ zeppelin-zengine ---
>>>>>> [INFO] Using 'UTF-8' encoding to copy filtered resources.
>>>>>> [INFO] Copying 17 resources
>>>>>> [INFO]
>>>>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @
>>>>>> zeppelin-zengine ---
>>>>>> [WARNING]
>>>>>> Dependency convergence error for
>>>>>> com.fasterxml.jackson.core:jackson-core:2.5.3 paths to dependency are:
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62
>>>>>> +-com.amazonaws:aws-java-sdk-core:1.10.62
>>>>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3
>>>>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3
>>>>>> and
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
>>>>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3
>>>>>>
>>>>>> [WARNING]
>>>>>> Dependency convergence error for
>>>>>> org.codehaus.jackson:jackson-mapper-asl:1.9.13 paths to dependency are:
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-com.github.eirslett:frontend-maven-plugin:1.3
>>>>>> +-com.github.eirslett:frontend-plugin-core:1.3
>>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>>> and
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
>>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8
>>>>>> and
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
>>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>>>
>>>>>> ... [skipped a number of other version convergence errors for
>>>>>> dependencies]
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>
Re: zeppelin build fails with DependencyConvergence error
Posted by Ruslan Dautkhanov <da...@gmail.com>.
Thank you Jeff
--
Ruslan Dautkhanov
On Thu, Jan 11, 2018 at 1:57 AM, Jeff Zhang <zj...@gmail.com> wrote:
>
> ZEPPELIN-3119 will fix this. Will update this thread once it is done
>
>
>
>
> Ruslan Dautkhanov <da...@gmail.com>于2017年12月29日周五 上午6:04写道：
>
>> The build failure messages all point to the zeppelin-zengine module in
>> the source code. In this commit: https://github.com/apache/
>> zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-
>> 98784f3ef76c2907324fa9e48e66cf47 , a dependency change was made to add
>> the org.apache.hadoop:hadoop-client which points to both
>> org.apache.hadoop:hadoop-common and org.apache.hadoop:hadoop-hdfs.
>> These two have dependencies upon different versions (at least for the
>> Cloudera version of them) of the org.codehaus.jackson:jackson-mapper-asl
>> library, 1.8.8 and 1.9.13 respectively.
>>
>> Was anyone able to build zeppelin with cloudera repo after
>> ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client
>> jar) PR #2455
>> was committed ?
>>
>>
>> On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <da...@gmail.com>
>> wrote:
>>
>>> We're now looking at shading option.
>>>
>>> Talking to Cloudera Support even minor upgrades to jackson known have
>>> caused issues in the past.
>>> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 -
>>> but this will be released mid-next year.
>>> So we're not waiting for that to happen.
>>>
>>> Yes, we will contribute back to the project when we find solution.
>>> Thanks for the suggestion Felix. Is this known if Zeppelin can work fine
>>> with jasckson 2.*2*.3?
>>> (certain dependencies currently list jackson 2.*5*.3)
>>>
>>>
>>>
>>> --
>>> Ruslan Dautkhanov
>>>
>>> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <felixcheung_m@hotmail.com
>>> > wrote:
>>>
>>>> Instead of exclusion, would it be better to use the version in the
>>>> cloudera repo?
>>>>
>>>> Please do consider contributing these changes back to Zeppelin source.
>>>> Thanks!
>>>>
>>>> _____________________________
>>>> From: Ruslan Dautkhanov <da...@gmail.com>
>>>> Sent: Monday, December 11, 2017 3:42 PM
>>>> Subject: Re: zeppelin build fails with DependencyConvergence error
>>>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
>>>>
>>>>
>>>>
>>>> Looks like master branch of Zeppelin still has compatibility issue with
>>>> Cloudera dependencies.
>>>>
>>>> When built using
>>>>
>>>> mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1
>>>> -Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e
>>>>
>>>> maven fails on jackson convergence error - see below email for more
>>>> details.
>>>> Looks like there was a change in Zeppelin that upgraded Jackson's
>>>> version?
>>>> So now it conflicts with older jackson library as referenced by
>>>> cloudera repo.
>>>>
>>>> workaround: Zeppelin builds fine with pom change [1] - the question is
>>>> now
>>>> would somebody expect Zeppelin would still be functioning correctly
>>>> with these exclusions?
>>>>
>>>>
>>>>
>>>> [1]
>>>>
>>>> --- a/zeppelin-zengine/pom.xml
>>>>> +++ b/zeppelin-zengine/pom.xml
>>>>> @@ -364,6 +364,30 @@
>>>>> <groupId>com.google.guava</groupId>
>>>>> <artifactId>guava</artifactId>
>>>>> </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>> + <artifactId>jackson-core</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>> + <artifactId>jackson-annotations</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>> + <artifactId>jackson-databind</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>org.codehaus.jackson</groupId>
>>>>> + <artifactId>jackson-mapper-asl</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>org.codehaus.jackson</groupId>
>>>>> + <artifactId>jackson-core-asl</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>org.apache.zookeeper</groupId>
>>>>> + <artifactId>zookeeper</artifactId>
>>>>> + </exclusion>
>>>>> </exclusions>
>>>>> </dependency>
>>>>>
>>>>
>>>>
>>>>
>>>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <
>>>> dautkhanov@gmail.com> wrote:
>>>>
>>>>> Building from a current Zeppelin snapshot fails with
>>>>> zeppelin build fails with org.apache.maven.plugins.
>>>>> enforcer.DependencyConvergence
>>>>> see details below.
>>>>>
>>>>> Build command
>>>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
>>>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo
>>>>> -Pscala-2.10 -Psparkr -pl '!*..excluded certain modules..*' -e
>>>>>
>>>>> maven 3.5.0
>>>>>> jdk 1.8.0_141
>>>>>> RHEL 7.3
>>>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7
>>>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel
>>>>>> latest zeppelin snapshot
>>>>>
>>>>>
>>>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen
>>>>> this problem before.
>>>>>
>>>>> Thanks,
>>>>> Ruslan
>>>>>
>>>>>
>>>>>
>>>>> [INFO] Scanning for projects...
>>>>> [WARNING]
>>>>> [WARNING] Some problems were encountered while building the effective
>>>>> model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.
>>>>> 8.0-SNAPSHOT
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
>>>>> @ line 940, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
>>>>> @ line 997, column 15
>>>>> [WARNING]
>>>>> [WARNING] Some problems were encountered while building the effective
>>>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
>>>>> @ line 467, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
>>>>> @ line 475, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.apache.maven.plugins:maven-compiler-plugin
>>>>> @ line 486, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
>>>>> @ line 496, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
>>>>> @ line 504, column 15
>>>>> [WARNING]
>>>>> [WARNING] It is highly recommended to fix these problems because they
>>>>> threaten the stability of your build.
>>>>> [WARNING]
>>>>> [WARNING] For this reason, future Maven versions might no longer
>>>>> support building such malformed projects.
>>>>> [WARNING]
>>>>> [WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT
>>>>> uses prerequisites which is only intended for maven-plugin projects but not
>>>>> for non maven-plugin projects. For such purposes you should use the
>>>>> maven-enforcer-plugin. See https://maven.apache.org/
>>>>> enforcer/enforcer-rules/requireMavenVersion.html
>>>>>
>>>>>
>>>>> ... [skip]
>>>>>
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO]
>>>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
>>>>> zeppelin-zengine ---
>>>>> [INFO]
>>>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
>>>>> zeppelin-zengine ---
>>>>> [INFO]
>>>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build)
>>>>> @ zeppelin-zengine ---
>>>>> [INFO]
>>>>> [INFO]
>>>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources)
>>>>> @ zeppelin-zengine ---
>>>>> [INFO] Using 'UTF-8' encoding to copy filtered resources.
>>>>> [INFO] Copying 17 resources
>>>>> [INFO]
>>>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @
>>>>> zeppelin-zengine ---
>>>>> [WARNING]
>>>>> Dependency convergence error for com.fasterxml.jackson.core:jackson-core:2.5.3
>>>>> paths to dependency are:
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62
>>>>> +-com.amazonaws:aws-java-sdk-core:1.10.62
>>>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3
>>>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3
>>>>> and
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
>>>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3
>>>>>
>>>>> [WARNING]
>>>>> Dependency convergence error for org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>> paths to dependency are:
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-com.github.eirslett:frontend-maven-plugin:1.3
>>>>> +-com.github.eirslett:frontend-plugin-core:1.3
>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>> and
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8
>>>>> and
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>>
>>>>> ... [skipped a number of other version convergence errors for
>>>>> dependencies]
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>
>>
Re: zeppelin build fails with DependencyConvergence error
Posted by Jeff Zhang <zj...@gmail.com>.
ZEPPELIN-3119 will fix this. Will update this thread once it is done
Ruslan Dautkhanov <da...@gmail.com>于2017年12月29日周五 上午6:04写道：
> The build failure messages all point to the zeppelin-zengine module in the
> source code. In this commit:
> https://github.com/apache/zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-98784f3ef76c2907324fa9e48e66cf47
> , a dependency change was made to add the org.apache.hadoop:hadoop-client
> which points to both org.apache.hadoop:hadoop-common and
> org.apache.hadoop:hadoop-hdfs. These two have dependencies upon different
> versions (at least for the Cloudera version of them) of the
> org.codehaus.jackson:jackson-mapper-asl library, 1.8.8 and 1.9.13
> respectively.
>
> Was anyone able to build zeppelin with cloudera repo after
> ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client jar)
> PR #2455
> was committed ?
>
>
> On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <da...@gmail.com>
> wrote:
>
>> We're now looking at shading option.
>>
>> Talking to Cloudera Support even minor upgrades to jackson known have
>> caused issues in the past.
>> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 - but
>> this will be released mid-next year.
>> So we're not waiting for that to happen.
>>
>> Yes, we will contribute back to the project when we find solution.
>> Thanks for the suggestion Felix. Is this known if Zeppelin can work fine
>> with jasckson 2.*2*.3?
>> (certain dependencies currently list jackson 2.*5*.3)
>>
>>
>>
>> --
>> Ruslan Dautkhanov
>>
>> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <fe...@hotmail.com>
>> wrote:
>>
>>> Instead of exclusion, would it be better to use the version in the
>>> cloudera repo?
>>>
>>> Please do consider contributing these changes back to Zeppelin source.
>>> Thanks!
>>>
>>> _____________________________
>>> From: Ruslan Dautkhanov <da...@gmail.com>
>>> Sent: Monday, December 11, 2017 3:42 PM
>>> Subject: Re: zeppelin build fails with DependencyConvergence error
>>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
>>>
>>>
>>>
>>> Looks like master branch of Zeppelin still has compatibility issue with
>>> Cloudera dependencies.
>>>
>>> When built using
>>>
>>> mvn clean package -DskipTests -Pspark-2.2
>>> -Dhadoop.version=2.6.0-cdh5.12.1 -Phadoop-2.6 -Pvendor-repo -pl '!...list
>>> of excluded packages' -e
>>>
>>> maven fails on jackson convergence error - see below email for more
>>> details.
>>> Looks like there was a change in Zeppelin that upgraded Jackson's
>>> version?
>>> So now it conflicts with older jackson library as referenced by cloudera
>>> repo.
>>>
>>> workaround: Zeppelin builds fine with pom change [1] - the question is
>>> now
>>> would somebody expect Zeppelin would still be functioning correctly with
>>> these exclusions?
>>>
>>>
>>>
>>> [1]
>>>
>>> --- a/zeppelin-zengine/pom.xml
>>>> +++ b/zeppelin-zengine/pom.xml
>>>> @@ -364,6 +364,30 @@
>>>> <groupId>com.google.guava</groupId>
>>>> <artifactId>guava</artifactId>
>>>> </exclusion>
>>>> + <exclusion>
>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>> + <artifactId>jackson-core</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>> + <artifactId>jackson-annotations</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>> + <artifactId>jackson-databind</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>org.codehaus.jackson</groupId>
>>>> + <artifactId>jackson-mapper-asl</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>org.codehaus.jackson</groupId>
>>>> + <artifactId>jackson-core-asl</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>org.apache.zookeeper</groupId>
>>>> + <artifactId>zookeeper</artifactId>
>>>> + </exclusion>
>>>> </exclusions>
>>>> </dependency>
>>>>
>>>
>>>
>>>
>>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <dautkhanov@gmail.com
>>> > wrote:
>>>
>>>> Building from a current Zeppelin snapshot fails with
>>>> zeppelin build fails with
>>>> org.apache.maven.plugins.enforcer.DependencyConvergence
>>>> see details below.
>>>>
>>>> Build command
>>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
>>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10
>>>> -Psparkr -pl '!*..excluded certain modules..*' -e
>>>>
>>>> maven 3.5.0
>>>>> jdk 1.8.0_141
>>>>> RHEL 7.3
>>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7
>>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel
>>>>> latest zeppelin snapshot
>>>>
>>>>
>>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen
>>>> this problem before.
>>>>
>>>> Thanks,
>>>> Ruslan
>>>>
>>>>
>>>>
>>>> [INFO] Scanning for projects...
>>>> [WARNING]
>>>> [WARNING] Some problems were encountered while building the effective
>>>> model for
>>>> org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8.0-SNAPSHOT
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 940,
>>>> column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 997,
>>>> column 15
>>>> [WARNING]
>>>> [WARNING] Some problems were encountered while building the effective
>>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.scala-tools:maven-scala-plugin @ line 467, column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 475, column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.apache.maven.plugins:maven-compiler-plugin @ line 486, column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.scala-tools:maven-scala-plugin @ line 496, column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 504, column 15
>>>> [WARNING]
>>>> [WARNING] It is highly recommended to fix these problems because they
>>>> threaten the stability of your build.
>>>> [WARNING]
>>>> [WARNING] For this reason, future Maven versions might no longer
>>>> support building such malformed projects.
>>>> [WARNING]
>>>> [WARNING] The project
>>>> org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT uses prerequisites
>>>> which is only intended for maven-plugin projects but not for non
>>>> maven-plugin projects. For such purposes you should use the
>>>> maven-enforcer-plugin. See
>>>> https://maven.apache.org/enforcer/enforcer-rules/requireMavenVersion.html
>>>>
>>>>
>>>> ... [skip]
>>>>
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO]
>>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
>>>> zeppelin-zengine ---
>>>> [INFO]
>>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
>>>> zeppelin-zengine ---
>>>> [INFO]
>>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @
>>>> zeppelin-zengine ---
>>>> [INFO]
>>>> [INFO]
>>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @
>>>> zeppelin-zengine ---
>>>> [INFO] Using 'UTF-8' encoding to copy filtered resources.
>>>> [INFO] Copying 17 resources
>>>> [INFO]
>>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @
>>>> zeppelin-zengine ---
>>>> [WARNING]
>>>> Dependency convergence error for
>>>> com.fasterxml.jackson.core:jackson-core:2.5.3 paths to dependency are:
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62
>>>> +-com.amazonaws:aws-java-sdk-core:1.10.62
>>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3
>>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3
>>>> and
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
>>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3
>>>>
>>>> [WARNING]
>>>> Dependency convergence error for
>>>> org.codehaus.jackson:jackson-mapper-asl:1.9.13 paths to dependency are:
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-com.github.eirslett:frontend-maven-plugin:1.3
>>>> +-com.github.eirslett:frontend-plugin-core:1.3
>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>> and
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8
>>>> and
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>
>>>> ... [skipped a number of other version convergence errors for
>>>> dependencies]
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>
>
Re: zeppelin build fails with DependencyConvergence error
Posted by Ruslan Dautkhanov <da...@gmail.com>.
The build failure messages all point to the zeppelin-zengine module in the
source code. In this commit:
https://github.com/apache/zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-98784f3ef76c2907324fa9e48e66cf47
, a dependency change was made to add the org.apache.hadoop:hadoop-client
which points to both org.apache.hadoop:hadoop-common and
org.apache.hadoop:hadoop-hdfs. These two have dependencies upon different
versions (at least for the Cloudera version of them) of the
org.codehaus.jackson:jackson-mapper-asl library, 1.8.8 and 1.9.13
respectively.
Was anyone able to build zeppelin with cloudera repo after
ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client jar)
PR #2455
was committed ?
On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <da...@gmail.com>
wrote:
> We're now looking at shading option.
>
> Talking to Cloudera Support even minor upgrades to jackson known have
> caused issues in the past.
> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 - but
> this will be released mid-next year.
> So we're not waiting for that to happen.
>
> Yes, we will contribute back to the project when we find solution.
> Thanks for the suggestion Felix. Is this known if Zeppelin can work fine
> with jasckson 2.*2*.3?
> (certain dependencies currently list jackson 2.*5*.3)
>
>
>
> --
> Ruslan Dautkhanov
>
> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <fe...@hotmail.com>
> wrote:
>
>> Instead of exclusion, would it be better to use the version in the
>> cloudera repo?
>>
>> Please do consider contributing these changes back to Zeppelin source.
>> Thanks!
>>
>> _____________________________
>> From: Ruslan Dautkhanov <da...@gmail.com>
>> Sent: Monday, December 11, 2017 3:42 PM
>> Subject: Re: zeppelin build fails with DependencyConvergence error
>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
>>
>>
>>
>> Looks like master branch of Zeppelin still has compatibility issue with
>> Cloudera dependencies.
>>
>> When built using
>>
>> mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1
>> -Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e
>>
>> maven fails on jackson convergence error - see below email for more
>> details.
>> Looks like there was a change in Zeppelin that upgraded Jackson's
>> version?
>> So now it conflicts with older jackson library as referenced by cloudera
>> repo.
>>
>> workaround: Zeppelin builds fine with pom change [1] - the question is
>> now
>> would somebody expect Zeppelin would still be functioning correctly with
>> these exclusions?
>>
>>
>>
>> [1]
>>
>> --- a/zeppelin-zengine/pom.xml
>>> +++ b/zeppelin-zengine/pom.xml
>>> @@ -364,6 +364,30 @@
>>> <groupId>com.google.guava</groupId>
>>> <artifactId>guava</artifactId>
>>> </exclusion>
>>> + <exclusion>
>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>> + <artifactId>jackson-core</artifactId>
>>> + </exclusion>
>>> + <exclusion>
>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>> + <artifactId>jackson-annotations</artifactId>
>>> + </exclusion>
>>> + <exclusion>
>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>> + <artifactId>jackson-databind</artifactId>
>>> + </exclusion>
>>> + <exclusion>
>>> + <groupId>org.codehaus.jackson</groupId>
>>> + <artifactId>jackson-mapper-asl</artifactId>
>>> + </exclusion>
>>> + <exclusion>
>>> + <groupId>org.codehaus.jackson</groupId>
>>> + <artifactId>jackson-core-asl</artifactId>
>>> + </exclusion>
>>> + <exclusion>
>>> + <groupId>org.apache.zookeeper</groupId>
>>> + <artifactId>zookeeper</artifactId>
>>> + </exclusion>
>>> </exclusions>
>>> </dependency>
>>>
>>
>>
>>
>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <da...@gmail.com>
>> wrote:
>>
>>> Building from a current Zeppelin snapshot fails with
>>> zeppelin build fails with org.apache.maven.plugins.enfor
>>> cer.DependencyConvergence
>>> see details below.
>>>
>>> Build command
>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo
>>> -Pscala-2.10 -Psparkr -pl '!*..excluded certain modules..*' -e
>>>
>>> maven 3.5.0
>>>> jdk 1.8.0_141
>>>> RHEL 7.3
>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7
>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel
>>>> latest zeppelin snapshot
>>>
>>>
>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen
>>> this problem before.
>>>
>>> Thanks,
>>> Ruslan
>>>
>>>
>>>
>>> [INFO] Scanning for projects...
>>> [WARNING]
>>> [WARNING] Some problems were encountered while building the effective
>>> model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8
>>> .0-SNAPSHOT
>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>> but found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
>>> @ line 940, column 15
>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>> but found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
>>> @ line 997, column 15
>>> [WARNING]
>>> [WARNING] Some problems were encountered while building the effective
>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>> but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
>>> @ line 467, column 15
>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>> but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
>>> @ line 475, column 15
>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>> but found duplicate declaration of plugin org.apache.maven.plugins:maven-compiler-plugin
>>> @ line 486, column 15
>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>> but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
>>> @ line 496, column 15
>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>> but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
>>> @ line 504, column 15
>>> [WARNING]
>>> [WARNING] It is highly recommended to fix these problems because they
>>> threaten the stability of your build.
>>> [WARNING]
>>> [WARNING] For this reason, future Maven versions might no longer support
>>> building such malformed projects.
>>> [WARNING]
>>> [WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT
>>> uses prerequisites which is only intended for maven-plugin projects but not
>>> for non maven-plugin projects. For such purposes you should use the
>>> maven-enforcer-plugin. See https://maven.apache.org/enfor
>>> cer/enforcer-rules/requireMavenVersion.html
>>>
>>>
>>> ... [skip]
>>>
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
>>> [INFO] ------------------------------------------------------------
>>> ------------
>>> [INFO]
>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
>>> zeppelin-zengine ---
>>> [INFO]
>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
>>> zeppelin-zengine ---
>>> [INFO]
>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @
>>> zeppelin-zengine ---
>>> [INFO]
>>> [INFO]
>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @
>>> zeppelin-zengine ---
>>> [INFO] Using 'UTF-8' encoding to copy filtered resources.
>>> [INFO] Copying 17 resources
>>> [INFO]
>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @
>>> zeppelin-zengine ---
>>> [WARNING]
>>> Dependency convergence error for com.fasterxml.jackson.core:jackson-core:2.5.3
>>> paths to dependency are:
>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62
>>> +-com.amazonaws:aws-java-sdk-core:1.10.62
>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3
>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3
>>> and
>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3
>>>
>>> [WARNING]
>>> Dependency convergence error for org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>> paths to dependency are:
>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>> +-com.github.eirslett:frontend-maven-plugin:1.3
>>> +-com.github.eirslett:frontend-plugin-core:1.3
>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>> and
>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8
>>> and
>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>
>>> ... [skipped a number of other version convergence errors for
>>> dependencies]
>>>
>>>
>>>
>>
>>
>>
>
Re: zeppelin build fails with DependencyConvergence error
Posted by Ruslan Dautkhanov <da...@gmail.com>.
We're now looking at shading option.
Talking to Cloudera Support even minor upgrades to jackson known have
caused issues in the past.
They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 - but
this will be released mid-next year.
So we're not waiting for that to happen.
Yes, we will contribute back to the project when we find solution.
Thanks for the suggestion Felix. Is this known if Zeppelin can work fine
with jasckson 2.*2*.3?
(certain dependencies currently list jackson 2.*5*.3)
--
Ruslan Dautkhanov
On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <fe...@hotmail.com>
wrote:
> Instead of exclusion, would it be better to use the version in the
> cloudera repo?
>
> Please do consider contributing these changes back to Zeppelin source.
> Thanks!
>
> _____________________________
> From: Ruslan Dautkhanov <da...@gmail.com>
> Sent: Monday, December 11, 2017 3:42 PM
> Subject: Re: zeppelin build fails with DependencyConvergence error
> To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
>
>
>
> Looks like master branch of Zeppelin still has compatibility issue with
> Cloudera dependencies.
>
> When built using
>
> mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1
> -Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e
>
> maven fails on jackson convergence error - see below email for more
> details.
> Looks like there was a change in Zeppelin that upgraded Jackson's version?
> So now it conflicts with older jackson library as referenced by cloudera
> repo.
>
> workaround: Zeppelin builds fine with pom change [1] - the question is now
> would somebody expect Zeppelin would still be functioning correctly with
> these exclusions?
>
>
>
> [1]
>
> --- a/zeppelin-zengine/pom.xml
>> +++ b/zeppelin-zengine/pom.xml
>> @@ -364,6 +364,30 @@
>> <groupId>com.google.guava</groupId>
>> <artifactId>guava</artifactId>
>> </exclusion>
>> + <exclusion>
>> + <groupId>com.fasterxml.jackson.core</groupId>
>> + <artifactId>jackson-core</artifactId>
>> + </exclusion>
>> + <exclusion>
>> + <groupId>com.fasterxml.jackson.core</groupId>
>> + <artifactId>jackson-annotations</artifactId>
>> + </exclusion>
>> + <exclusion>
>> + <groupId>com.fasterxml.jackson.core</groupId>
>> + <artifactId>jackson-databind</artifactId>
>> + </exclusion>
>> + <exclusion>
>> + <groupId>org.codehaus.jackson</groupId>
>> + <artifactId>jackson-mapper-asl</artifactId>
>> + </exclusion>
>> + <exclusion>
>> + <groupId>org.codehaus.jackson</groupId>
>> + <artifactId>jackson-core-asl</artifactId>
>> + </exclusion>
>> + <exclusion>
>> + <groupId>org.apache.zookeeper</groupId>
>> + <artifactId>zookeeper</artifactId>
>> + </exclusion>
>> </exclusions>
>> </dependency>
>>
>
>
>
> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <da...@gmail.com>
> wrote:
>
>> Building from a current Zeppelin snapshot fails with
>> zeppelin build fails with org.apache.maven.plugins.enfor
>> cer.DependencyConvergence
>> see details below.
>>
>> Build command
>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10
>> -Psparkr -pl '!*..excluded certain modules..*' -e
>>
>> maven 3.5.0
>>> jdk 1.8.0_141
>>> RHEL 7.3
>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7
>>> nodejs.x86_64 1:6.11.1-1.el7 @epel
>>> latest zeppelin snapshot
>>
>>
>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen
>> this problem before.
>>
>> Thanks,
>> Ruslan
>>
>>
>>
>> [INFO] Scanning for projects...
>> [WARNING]
>> [WARNING] Some problems were encountered while building the effective
>> model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8
>> .0-SNAPSHOT
>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
>> found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
>> @ line 940, column 15
>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
>> found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
>> @ line 997, column 15
>> [WARNING]
>> [WARNING] Some problems were encountered while building the effective
>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
>> found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
>> @ line 467, column 15
>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
>> found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
>> @ line 475, column 15
>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
>> found duplicate declaration of plugin org.apache.maven.plugins:maven-compiler-plugin
>> @ line 486, column 15
>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
>> found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
>> @ line 496, column 15
>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but
>> found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
>> @ line 504, column 15
>> [WARNING]
>> [WARNING] It is highly recommended to fix these problems because they
>> threaten the stability of your build.
>> [WARNING]
>> [WARNING] For this reason, future Maven versions might no longer support
>> building such malformed projects.
>> [WARNING]
>> [WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT
>> uses prerequisites which is only intended for maven-plugin projects but not
>> for non maven-plugin projects. For such purposes you should use the
>> maven-enforcer-plugin. See https://maven.apache.org/enfor
>> cer/enforcer-rules/requireMavenVersion.html
>>
>>
>> ... [skip]
>>
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
>> [INFO] ------------------------------------------------------------
>> ------------
>> [INFO]
>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
>> zeppelin-zengine ---
>> [INFO]
>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
>> zeppelin-zengine ---
>> [INFO]
>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @
>> zeppelin-zengine ---
>> [INFO]
>> [INFO]
>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @
>> zeppelin-zengine ---
>> [INFO] Using 'UTF-8' encoding to copy filtered resources.
>> [INFO] Copying 17 resources
>> [INFO]
>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @
>> zeppelin-zengine ---
>> [WARNING]
>> Dependency convergence error for com.fasterxml.jackson.core:jackson-core:2.5.3
>> paths to dependency are:
>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>> +-com.amazonaws:aws-java-sdk-s3:1.10.62
>> +-com.amazonaws:aws-java-sdk-core:1.10.62
>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3
>> +-com.fasterxml.jackson.core:jackson-core:2.5.3
>> and
>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
>> +-com.fasterxml.jackson.core:jackson-core:2.2.3
>>
>> [WARNING]
>> Dependency convergence error for org.codehaus.jackson:jackson-mapper-asl:1.9.13
>> paths to dependency are:
>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>> +-com.github.eirslett:frontend-maven-plugin:1.3
>> +-com.github.eirslett:frontend-plugin-core:1.3
>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>> and
>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8
>> and
>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>
>> ... [skipped a number of other version convergence errors for
>> dependencies]
>>
>>
>>
>
>
>
Re: zeppelin build fails with DependencyConvergence error
Posted by Felix Cheung <fe...@hotmail.com>.
Instead of exclusion, would it be better to use the version in the cloudera repo?
Please do consider contributing these changes back to Zeppelin source. Thanks!
_____________________________
From: Ruslan Dautkhanov <da...@gmail.com>
Sent: Monday, December 11, 2017 3:42 PM
Subject: Re: zeppelin build fails with DependencyConvergence error
To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
Looks like master branch of Zeppelin still has compatibility issue with Cloudera dependencies.
When built using
mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1 -Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e
maven fails on jackson convergence error - see below email for more details.
Looks like there was a change in Zeppelin that upgraded Jackson's version?
So now it conflicts with older jackson library as referenced by cloudera repo.
workaround: Zeppelin builds fine with pom change [1] - the question is now
would somebody expect Zeppelin would still be functioning correctly with these exclusions?
[1]
--- a/zeppelin-zengine/pom.xml
+++ b/zeppelin-zengine/pom.xml
@@ -364,6 +364,30 @@
<groupId>com.google.guava</groupId>
<artifactId>guava</artifactId>
</exclusion>
+ <exclusion>
+ <groupId>com.fasterxml.jackson.core</groupId>
+ <artifactId>jackson-core</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>com.fasterxml.jackson.core</groupId>
+ <artifactId>jackson-annotations</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>com.fasterxml.jackson.core</groupId>
+ <artifactId>jackson-databind</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-mapper-asl</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>org.codehaus.jackson</groupId>
+ <artifactId>jackson-core-asl</artifactId>
+ </exclusion>
+ <exclusion>
+ <groupId>org.apache.zookeeper</groupId>
+ <artifactId>zookeeper</artifactId>
+ </exclusion>
</exclusions>
</dependency>
On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <da...@gmail.com>> wrote:
Building from a current Zeppelin snapshot fails with
zeppelin build fails with org.apache.maven.plugins.enforcer.DependencyConvergence
see details below.
Build command
/opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10 -Psparkr -pl '!..excluded certain modules..' -e
maven 3.5.0
jdk 1.8.0_141
RHEL 7.3
npm.x86_64 1:3.10.10-1.6.11.1.1.el7
nodejs.x86_64 1:6.11.1-1.el7 @epel
latest zeppelin snapshot
Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen this problem before.
Thanks,
Ruslan
[INFO] Scanning for projects...
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin @ line 940, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin @ line 997, column 15
[WARNING]
[WARNING] Some problems were encountered while building the effective model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin @ line 467, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ line 475, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-compiler-plugin @ line 486, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin @ line 496, column 15
[WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin @ line 504, column 15
[WARNING]
[WARNING] It is highly recommended to fix these problems because they threaten the stability of your build.
[WARNING]
[WARNING] For this reason, future Maven versions might no longer support building such malformed projects.
[WARNING]
[WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT uses prerequisites which is only intended for maven-plugin projects but not for non maven-plugin projects. For such purposes you should use the maven-enforcer-plugin. See https://maven.apache.org/enforcer/enforcer-rules/requireMavenVersion.html
... [skip]
[INFO] ------------------------------------------------------------------------
[INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
[INFO] ------------------------------------------------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @ zeppelin-zengine ---
[INFO]
[INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @ zeppelin-zengine ---
[INFO]
[INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @ zeppelin-zengine ---
[INFO]
[INFO]
[INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ zeppelin-zengine ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] Copying 17 resources
[INFO]
[INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @ zeppelin-zengine ---
[WARNING]
Dependency convergence error for com.fasterxml.jackson.core:jackson-core:2.5.3 paths to dependency are:
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-com.amazonaws:aws-java-sdk-s3:1.10.62
+-com.amazonaws:aws-java-sdk-core:1.10.62
+-com.fasterxml.jackson.core:jackson-databind:2.5.3
+-com.fasterxml.jackson.core:jackson-core:2.5.3
and
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
+-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
+-com.fasterxml.jackson.core:jackson-core:2.2.3
[WARNING]
Dependency convergence error for org.codehaus.jackson:jackson-mapper-asl:1.9.13 paths to dependency are:
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-com.github.eirslett:frontend-maven-plugin:1.3
+-com.github.eirslett:frontend-plugin-core:1.3
+-org.codehaus.jackson:jackson-mapper-asl:1.9.13
and
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
+-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
+-org.codehaus.jackson:jackson-mapper-asl:1.8.8
and
+-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
+-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
+-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
+-org.codehaus.jackson:jackson-mapper-asl:1.9.13
... [skipped a number of other version convergence errors for dependencies]