You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by Jeff Zhang <zj...@gmail.com> on 2018/01/11 08:57:17 UTC
Re: zeppelin build fails with DependencyConvergence error
ZEPPELIN-3119 will fix this. Will update this thread once it is done
Ruslan Dautkhanov <da...@gmail.com>于2017年12月29日周五 上午6:04写道：
> The build failure messages all point to the zeppelin-zengine module in the
> source code. In this commit:
> https://github.com/apache/zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-98784f3ef76c2907324fa9e48e66cf47
> , a dependency change was made to add the org.apache.hadoop:hadoop-client
> which points to both org.apache.hadoop:hadoop-common and
> org.apache.hadoop:hadoop-hdfs. These two have dependencies upon different
> versions (at least for the Cloudera version of them) of the
> org.codehaus.jackson:jackson-mapper-asl library, 1.8.8 and 1.9.13
> respectively.
>
> Was anyone able to build zeppelin with cloudera repo after
> ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client jar)
> PR #2455
> was committed ?
>
>
> On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <da...@gmail.com>
> wrote:
>
>> We're now looking at shading option.
>>
>> Talking to Cloudera Support even minor upgrades to jackson known have
>> caused issues in the past.
>> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 - but
>> this will be released mid-next year.
>> So we're not waiting for that to happen.
>>
>> Yes, we will contribute back to the project when we find solution.
>> Thanks for the suggestion Felix. Is this known if Zeppelin can work fine
>> with jasckson 2.*2*.3?
>> (certain dependencies currently list jackson 2.*5*.3)
>>
>>
>>
>> --
>> Ruslan Dautkhanov
>>
>> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <fe...@hotmail.com>
>> wrote:
>>
>>> Instead of exclusion, would it be better to use the version in the
>>> cloudera repo?
>>>
>>> Please do consider contributing these changes back to Zeppelin source.
>>> Thanks!
>>>
>>> _____________________________
>>> From: Ruslan Dautkhanov <da...@gmail.com>
>>> Sent: Monday, December 11, 2017 3:42 PM
>>> Subject: Re: zeppelin build fails with DependencyConvergence error
>>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
>>>
>>>
>>>
>>> Looks like master branch of Zeppelin still has compatibility issue with
>>> Cloudera dependencies.
>>>
>>> When built using
>>>
>>> mvn clean package -DskipTests -Pspark-2.2
>>> -Dhadoop.version=2.6.0-cdh5.12.1 -Phadoop-2.6 -Pvendor-repo -pl '!...list
>>> of excluded packages' -e
>>>
>>> maven fails on jackson convergence error - see below email for more
>>> details.
>>> Looks like there was a change in Zeppelin that upgraded Jackson's
>>> version?
>>> So now it conflicts with older jackson library as referenced by cloudera
>>> repo.
>>>
>>> workaround: Zeppelin builds fine with pom change [1] - the question is
>>> now
>>> would somebody expect Zeppelin would still be functioning correctly with
>>> these exclusions?
>>>
>>>
>>>
>>> [1]
>>>
>>> --- a/zeppelin-zengine/pom.xml
>>>> +++ b/zeppelin-zengine/pom.xml
>>>> @@ -364,6 +364,30 @@
>>>> <groupId>com.google.guava</groupId>
>>>> <artifactId>guava</artifactId>
>>>> </exclusion>
>>>> + <exclusion>
>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>> + <artifactId>jackson-core</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>> + <artifactId>jackson-annotations</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>> + <artifactId>jackson-databind</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>org.codehaus.jackson</groupId>
>>>> + <artifactId>jackson-mapper-asl</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>org.codehaus.jackson</groupId>
>>>> + <artifactId>jackson-core-asl</artifactId>
>>>> + </exclusion>
>>>> + <exclusion>
>>>> + <groupId>org.apache.zookeeper</groupId>
>>>> + <artifactId>zookeeper</artifactId>
>>>> + </exclusion>
>>>> </exclusions>
>>>> </dependency>
>>>>
>>>
>>>
>>>
>>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <dautkhanov@gmail.com
>>> > wrote:
>>>
>>>> Building from a current Zeppelin snapshot fails with
>>>> zeppelin build fails with
>>>> org.apache.maven.plugins.enforcer.DependencyConvergence
>>>> see details below.
>>>>
>>>> Build command
>>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
>>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10
>>>> -Psparkr -pl '!*..excluded certain modules..*' -e
>>>>
>>>> maven 3.5.0
>>>>> jdk 1.8.0_141
>>>>> RHEL 7.3
>>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7
>>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel
>>>>> latest zeppelin snapshot
>>>>
>>>>
>>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen
>>>> this problem before.
>>>>
>>>> Thanks,
>>>> Ruslan
>>>>
>>>>
>>>>
>>>> [INFO] Scanning for projects...
>>>> [WARNING]
>>>> [WARNING] Some problems were encountered while building the effective
>>>> model for
>>>> org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8.0-SNAPSHOT
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 940,
>>>> column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 997,
>>>> column 15
>>>> [WARNING]
>>>> [WARNING] Some problems were encountered while building the effective
>>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.scala-tools:maven-scala-plugin @ line 467, column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 475, column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.apache.maven.plugins:maven-compiler-plugin @ line 486, column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.scala-tools:maven-scala-plugin @ line 496, column 15
>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>> but found duplicate declaration of plugin
>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 504, column 15
>>>> [WARNING]
>>>> [WARNING] It is highly recommended to fix these problems because they
>>>> threaten the stability of your build.
>>>> [WARNING]
>>>> [WARNING] For this reason, future Maven versions might no longer
>>>> support building such malformed projects.
>>>> [WARNING]
>>>> [WARNING] The project
>>>> org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT uses prerequisites
>>>> which is only intended for maven-plugin projects but not for non
>>>> maven-plugin projects. For such purposes you should use the
>>>> maven-enforcer-plugin. See
>>>> https://maven.apache.org/enforcer/enforcer-rules/requireMavenVersion.html
>>>>
>>>>
>>>> ... [skip]
>>>>
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
>>>> [INFO]
>>>> ------------------------------------------------------------------------
>>>> [INFO]
>>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
>>>> zeppelin-zengine ---
>>>> [INFO]
>>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
>>>> zeppelin-zengine ---
>>>> [INFO]
>>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @
>>>> zeppelin-zengine ---
>>>> [INFO]
>>>> [INFO]
>>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @
>>>> zeppelin-zengine ---
>>>> [INFO] Using 'UTF-8' encoding to copy filtered resources.
>>>> [INFO] Copying 17 resources
>>>> [INFO]
>>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @
>>>> zeppelin-zengine ---
>>>> [WARNING]
>>>> Dependency convergence error for
>>>> com.fasterxml.jackson.core:jackson-core:2.5.3 paths to dependency are:
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62
>>>> +-com.amazonaws:aws-java-sdk-core:1.10.62
>>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3
>>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3
>>>> and
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
>>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3
>>>>
>>>> [WARNING]
>>>> Dependency convergence error for
>>>> org.codehaus.jackson:jackson-mapper-asl:1.9.13 paths to dependency are:
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-com.github.eirslett:frontend-maven-plugin:1.3
>>>> +-com.github.eirslett:frontend-plugin-core:1.3
>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>> and
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8
>>>> and
>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>
>>>> ... [skipped a number of other version convergence errors for
>>>> dependencies]
>>>>
>>>>
>>>>
>>>
>>>
>>>
>>
>
Re: zeppelin build fails with DependencyConvergence error
Posted by Jeff Zhang <zj...@gmail.com>.
ZEPPELIN-3119 is merged, which will be included in 0.8.0
Ruslan Dautkhanov <da...@gmail.com>于2018年1月12日周五 上午12:35写道：
> Thank you Jeff
>
>
> --
> Ruslan Dautkhanov
>
> On Thu, Jan 11, 2018 at 1:57 AM, Jeff Zhang <zj...@gmail.com> wrote:
>
>>
>> ZEPPELIN-3119 will fix this. Will update this thread once it is done
>>
>>
>>
>>
>> Ruslan Dautkhanov <da...@gmail.com>于2017年12月29日周五 上午6:04写道：
>>
>>> The build failure messages all point to the zeppelin-zengine module in
>>> the source code. In this commit:
>>> https://github.com/apache/zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-98784f3ef76c2907324fa9e48e66cf47
>>> , a dependency change was made to add the org.apache.hadoop:hadoop-client
>>> which points to both org.apache.hadoop:hadoop-common and
>>> org.apache.hadoop:hadoop-hdfs. These two have dependencies upon different
>>> versions (at least for the Cloudera version of them) of the
>>> org.codehaus.jackson:jackson-mapper-asl library, 1.8.8 and 1.9.13
>>> respectively.
>>>
>>> Was anyone able to build zeppelin with cloudera repo after
>>> ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client
>>> jar) PR #2455
>>> was committed ?
>>>
>>>
>>> On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <dautkhanov@gmail.com
>>> > wrote:
>>>
>>>> We're now looking at shading option.
>>>>
>>>> Talking to Cloudera Support even minor upgrades to jackson known have
>>>> caused issues in the past.
>>>> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 -
>>>> but this will be released mid-next year.
>>>> So we're not waiting for that to happen.
>>>>
>>>> Yes, we will contribute back to the project when we find solution.
>>>> Thanks for the suggestion Felix. Is this known if Zeppelin can work
>>>> fine with jasckson 2.*2*.3?
>>>> (certain dependencies currently list jackson 2.*5*.3)
>>>>
>>>>
>>>>
>>>> --
>>>> Ruslan Dautkhanov
>>>>
>>>> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <
>>>> felixcheung_m@hotmail.com> wrote:
>>>>
>>>>> Instead of exclusion, would it be better to use the version in the
>>>>> cloudera repo?
>>>>>
>>>>> Please do consider contributing these changes back to Zeppelin source.
>>>>> Thanks!
>>>>>
>>>>> _____________________________
>>>>> From: Ruslan Dautkhanov <da...@gmail.com>
>>>>> Sent: Monday, December 11, 2017 3:42 PM
>>>>> Subject: Re: zeppelin build fails with DependencyConvergence error
>>>>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
>>>>>
>>>>>
>>>>>
>>>>> Looks like master branch of Zeppelin still has compatibility issue
>>>>> with Cloudera dependencies.
>>>>>
>>>>> When built using
>>>>>
>>>>> mvn clean package -DskipTests -Pspark-2.2
>>>>> -Dhadoop.version=2.6.0-cdh5.12.1 -Phadoop-2.6 -Pvendor-repo -pl '!...list
>>>>> of excluded packages' -e
>>>>>
>>>>> maven fails on jackson convergence error - see below email for more
>>>>> details.
>>>>> Looks like there was a change in Zeppelin that upgraded Jackson's
>>>>> version?
>>>>> So now it conflicts with older jackson library as referenced by
>>>>> cloudera repo.
>>>>>
>>>>> workaround: Zeppelin builds fine with pom change [1] - the question is
>>>>> now
>>>>> would somebody expect Zeppelin would still be functioning correctly
>>>>> with these exclusions?
>>>>>
>>>>>
>>>>>
>>>>> [1]
>>>>>
>>>>> --- a/zeppelin-zengine/pom.xml
>>>>>> +++ b/zeppelin-zengine/pom.xml
>>>>>> @@ -364,6 +364,30 @@
>>>>>> <groupId>com.google.guava</groupId>
>>>>>> <artifactId>guava</artifactId>
>>>>>> </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>>> + <artifactId>jackson-core</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>>> + <artifactId>jackson-annotations</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>>> + <artifactId>jackson-databind</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>org.codehaus.jackson</groupId>
>>>>>> + <artifactId>jackson-mapper-asl</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>org.codehaus.jackson</groupId>
>>>>>> + <artifactId>jackson-core-asl</artifactId>
>>>>>> + </exclusion>
>>>>>> + <exclusion>
>>>>>> + <groupId>org.apache.zookeeper</groupId>
>>>>>> + <artifactId>zookeeper</artifactId>
>>>>>> + </exclusion>
>>>>>> </exclusions>
>>>>>> </dependency>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <
>>>>> dautkhanov@gmail.com> wrote:
>>>>>
>>>>>> Building from a current Zeppelin snapshot fails with
>>>>>> zeppelin build fails with
>>>>>> org.apache.maven.plugins.enforcer.DependencyConvergence
>>>>>> see details below.
>>>>>>
>>>>>> Build command
>>>>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
>>>>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo -Pscala-2.10
>>>>>> -Psparkr -pl '!*..excluded certain modules..*' -e
>>>>>>
>>>>>> maven 3.5.0
>>>>>>> jdk 1.8.0_141
>>>>>>> RHEL 7.3
>>>>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7
>>>>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel
>>>>>>> latest zeppelin snapshot
>>>>>>
>>>>>>
>>>>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen
>>>>>> this problem before.
>>>>>>
>>>>>> Thanks,
>>>>>> Ruslan
>>>>>>
>>>>>>
>>>>>>
>>>>>> [INFO] Scanning for projects...
>>>>>> [WARNING]
>>>>>> [WARNING] Some problems were encountered while building the effective
>>>>>> model for
>>>>>> org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8.0-SNAPSHOT
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 940,
>>>>>> column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> com.googlecode.maven-download-plugin:download-maven-plugin @ line 997,
>>>>>> column 15
>>>>>> [WARNING]
>>>>>> [WARNING] Some problems were encountered while building the effective
>>>>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.scala-tools:maven-scala-plugin @ line 467, column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 475, column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.apache.maven.plugins:maven-compiler-plugin @ line 486, column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.scala-tools:maven-scala-plugin @ line 496, column 15
>>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>>> but found duplicate declaration of plugin
>>>>>> org.apache.maven.plugins:maven-surefire-plugin @ line 504, column 15
>>>>>> [WARNING]
>>>>>> [WARNING] It is highly recommended to fix these problems because they
>>>>>> threaten the stability of your build.
>>>>>> [WARNING]
>>>>>> [WARNING] For this reason, future Maven versions might no longer
>>>>>> support building such malformed projects.
>>>>>> [WARNING]
>>>>>> [WARNING] The project
>>>>>> org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT uses prerequisites
>>>>>> which is only intended for maven-plugin projects but not for non
>>>>>> maven-plugin projects. For such purposes you should use the
>>>>>> maven-enforcer-plugin. See
>>>>>> https://maven.apache.org/enforcer/enforcer-rules/requireMavenVersion.html
>>>>>>
>>>>>>
>>>>>> ... [skip]
>>>>>>
>>>>>> [INFO]
>>>>>> ------------------------------------------------------------------------
>>>>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
>>>>>> [INFO]
>>>>>> ------------------------------------------------------------------------
>>>>>> [INFO]
>>>>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
>>>>>> zeppelin-zengine ---
>>>>>> [INFO]
>>>>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
>>>>>> zeppelin-zengine ---
>>>>>> [INFO]
>>>>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build)
>>>>>> @ zeppelin-zengine ---
>>>>>> [INFO]
>>>>>> [INFO]
>>>>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources)
>>>>>> @ zeppelin-zengine ---
>>>>>> [INFO] Using 'UTF-8' encoding to copy filtered resources.
>>>>>> [INFO] Copying 17 resources
>>>>>> [INFO]
>>>>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @
>>>>>> zeppelin-zengine ---
>>>>>> [WARNING]
>>>>>> Dependency convergence error for
>>>>>> com.fasterxml.jackson.core:jackson-core:2.5.3 paths to dependency are:
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62
>>>>>> +-com.amazonaws:aws-java-sdk-core:1.10.62
>>>>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3
>>>>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3
>>>>>> and
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
>>>>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3
>>>>>>
>>>>>> [WARNING]
>>>>>> Dependency convergence error for
>>>>>> org.codehaus.jackson:jackson-mapper-asl:1.9.13 paths to dependency are:
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-com.github.eirslett:frontend-maven-plugin:1.3
>>>>>> +-com.github.eirslett:frontend-plugin-core:1.3
>>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>>> and
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
>>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8
>>>>>> and
>>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
>>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>>>
>>>>>> ... [skipped a number of other version convergence errors for
>>>>>> dependencies]
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>
>>>
>
Re: zeppelin build fails with DependencyConvergence error
Posted by Ruslan Dautkhanov <da...@gmail.com>.
Thank you Jeff
--
Ruslan Dautkhanov
On Thu, Jan 11, 2018 at 1:57 AM, Jeff Zhang <zj...@gmail.com> wrote:
>
> ZEPPELIN-3119 will fix this. Will update this thread once it is done
>
>
>
>
> Ruslan Dautkhanov <da...@gmail.com>于2017年12月29日周五 上午6:04写道：
>
>> The build failure messages all point to the zeppelin-zengine module in
>> the source code. In this commit: https://github.com/apache/
>> zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-
>> 98784f3ef76c2907324fa9e48e66cf47 , a dependency change was made to add
>> the org.apache.hadoop:hadoop-client which points to both
>> org.apache.hadoop:hadoop-common and org.apache.hadoop:hadoop-hdfs.
>> These two have dependencies upon different versions (at least for the
>> Cloudera version of them) of the org.codehaus.jackson:jackson-mapper-asl
>> library, 1.8.8 and 1.9.13 respectively.
>>
>> Was anyone able to build zeppelin with cloudera repo after
>> ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client
>> jar) PR #2455
>> was committed ?
>>
>>
>> On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <da...@gmail.com>
>> wrote:
>>
>>> We're now looking at shading option.
>>>
>>> Talking to Cloudera Support even minor upgrades to jackson known have
>>> caused issues in the past.
>>> They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 -
>>> but this will be released mid-next year.
>>> So we're not waiting for that to happen.
>>>
>>> Yes, we will contribute back to the project when we find solution.
>>> Thanks for the suggestion Felix. Is this known if Zeppelin can work fine
>>> with jasckson 2.*2*.3?
>>> (certain dependencies currently list jackson 2.*5*.3)
>>>
>>>
>>>
>>> --
>>> Ruslan Dautkhanov
>>>
>>> On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <felixcheung_m@hotmail.com
>>> > wrote:
>>>
>>>> Instead of exclusion, would it be better to use the version in the
>>>> cloudera repo?
>>>>
>>>> Please do consider contributing these changes back to Zeppelin source.
>>>> Thanks!
>>>>
>>>> _____________________________
>>>> From: Ruslan Dautkhanov <da...@gmail.com>
>>>> Sent: Monday, December 11, 2017 3:42 PM
>>>> Subject: Re: zeppelin build fails with DependencyConvergence error
>>>> To: Zeppelin Users <us...@zeppelin.incubator.apache.org>
>>>>
>>>>
>>>>
>>>> Looks like master branch of Zeppelin still has compatibility issue with
>>>> Cloudera dependencies.
>>>>
>>>> When built using
>>>>
>>>> mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1
>>>> -Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e
>>>>
>>>> maven fails on jackson convergence error - see below email for more
>>>> details.
>>>> Looks like there was a change in Zeppelin that upgraded Jackson's
>>>> version?
>>>> So now it conflicts with older jackson library as referenced by
>>>> cloudera repo.
>>>>
>>>> workaround: Zeppelin builds fine with pom change [1] - the question is
>>>> now
>>>> would somebody expect Zeppelin would still be functioning correctly
>>>> with these exclusions?
>>>>
>>>>
>>>>
>>>> [1]
>>>>
>>>> --- a/zeppelin-zengine/pom.xml
>>>>> +++ b/zeppelin-zengine/pom.xml
>>>>> @@ -364,6 +364,30 @@
>>>>> <groupId>com.google.guava</groupId>
>>>>> <artifactId>guava</artifactId>
>>>>> </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>> + <artifactId>jackson-core</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>> + <artifactId>jackson-annotations</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>com.fasterxml.jackson.core</groupId>
>>>>> + <artifactId>jackson-databind</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>org.codehaus.jackson</groupId>
>>>>> + <artifactId>jackson-mapper-asl</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>org.codehaus.jackson</groupId>
>>>>> + <artifactId>jackson-core-asl</artifactId>
>>>>> + </exclusion>
>>>>> + <exclusion>
>>>>> + <groupId>org.apache.zookeeper</groupId>
>>>>> + <artifactId>zookeeper</artifactId>
>>>>> + </exclusion>
>>>>> </exclusions>
>>>>> </dependency>
>>>>>
>>>>
>>>>
>>>>
>>>> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <
>>>> dautkhanov@gmail.com> wrote:
>>>>
>>>>> Building from a current Zeppelin snapshot fails with
>>>>> zeppelin build fails with org.apache.maven.plugins.
>>>>> enforcer.DependencyConvergence
>>>>> see details below.
>>>>>
>>>>> Build command
>>>>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2
>>>>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo
>>>>> -Pscala-2.10 -Psparkr -pl '!*..excluded certain modules..*' -e
>>>>>
>>>>> maven 3.5.0
>>>>>> jdk 1.8.0_141
>>>>>> RHEL 7.3
>>>>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7
>>>>>> nodejs.x86_64 1:6.11.1-1.el7 @epel
>>>>>> latest zeppelin snapshot
>>>>>
>>>>>
>>>>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen
>>>>> this problem before.
>>>>>
>>>>> Thanks,
>>>>> Ruslan
>>>>>
>>>>>
>>>>>
>>>>> [INFO] Scanning for projects...
>>>>> [WARNING]
>>>>> [WARNING] Some problems were encountered while building the effective
>>>>> model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.
>>>>> 8.0-SNAPSHOT
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
>>>>> @ line 940, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin com.googlecode.maven-download-plugin:download-maven-plugin
>>>>> @ line 997, column 15
>>>>> [WARNING]
>>>>> [WARNING] Some problems were encountered while building the effective
>>>>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
>>>>> @ line 467, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
>>>>> @ line 475, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.apache.maven.plugins:maven-compiler-plugin
>>>>> @ line 486, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin
>>>>> @ line 496, column 15
>>>>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique
>>>>> but found duplicate declaration of plugin org.apache.maven.plugins:maven-surefire-plugin
>>>>> @ line 504, column 15
>>>>> [WARNING]
>>>>> [WARNING] It is highly recommended to fix these problems because they
>>>>> threaten the stability of your build.
>>>>> [WARNING]
>>>>> [WARNING] For this reason, future Maven versions might no longer
>>>>> support building such malformed projects.
>>>>> [WARNING]
>>>>> [WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT
>>>>> uses prerequisites which is only intended for maven-plugin projects but not
>>>>> for non maven-plugin projects. For such purposes you should use the
>>>>> maven-enforcer-plugin. See https://maven.apache.org/
>>>>> enforcer/enforcer-rules/requireMavenVersion.html
>>>>>
>>>>>
>>>>> ... [skip]
>>>>>
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT
>>>>> [INFO] ------------------------------------------------------------
>>>>> ------------
>>>>> [INFO]
>>>>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @
>>>>> zeppelin-zengine ---
>>>>> [INFO]
>>>>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @
>>>>> zeppelin-zengine ---
>>>>> [INFO]
>>>>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build)
>>>>> @ zeppelin-zengine ---
>>>>> [INFO]
>>>>> [INFO]
>>>>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources)
>>>>> @ zeppelin-zengine ---
>>>>> [INFO] Using 'UTF-8' encoding to copy filtered resources.
>>>>> [INFO] Copying 17 resources
>>>>> [INFO]
>>>>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @
>>>>> zeppelin-zengine ---
>>>>> [WARNING]
>>>>> Dependency convergence error for com.fasterxml.jackson.core:jackson-core:2.5.3
>>>>> paths to dependency are:
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-com.amazonaws:aws-java-sdk-s3:1.10.62
>>>>> +-com.amazonaws:aws-java-sdk-core:1.10.62
>>>>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3
>>>>> +-com.fasterxml.jackson.core:jackson-core:2.5.3
>>>>> and
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0
>>>>> +-com.fasterxml.jackson.core:jackson-core:2.2.3
>>>>>
>>>>> [WARNING]
>>>>> Dependency convergence error for org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>> paths to dependency are:
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-com.github.eirslett:frontend-maven-plugin:1.3
>>>>> +-com.github.eirslett:frontend-plugin-core:1.3
>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>> and
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0
>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8
>>>>> and
>>>>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT
>>>>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0
>>>>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0
>>>>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13
>>>>>
>>>>> ... [skipped a number of other version convergence errors for
>>>>> dependencies]
>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>
>>