[GitHub] [bigtop] iwasakims edited a comment on pull request #693: BIGTOP-3444. Bump Hadoop to 2.10.1.

[GitBox <gi...@apache.org>]

iwasakims edited a comment on pull request #693:
URL: https://github.com/apache/bigtop/pull/693#issuecomment-724591807


   ```
   [INFO] org.apache.zeppelin:zeppelin-zengine:jar:0.8.2
   ...
   [INFO] +- org.apache.hadoop:hadoop-azure:jar:2.10.0:compile
   [INFO] |  \- com.microsoft.azure:azure-storage:jar:5.4.0:compile
   ```
   
   Dependency tree shows that zeppelin-0.8.2 was compiled against hadoop-azure-2.10.0 and azure-storage-5.4.0 [even if the transitive dependency of hadoop-azure is azure-storage-7.0.0](https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-azure/2.10.0).
   
   If we update the hadoop.version to 2.10.1, the azure-storage version is changed to 7.0.1.
   ```
   [INFO] org.apache.zeppelin:zeppelin-zengine:jar:0.8.2
   ...
   [INFO] +- org.apache.hadoop:hadoop-azure:jar:2.10.1:compile
   [INFO] |  \- com.microsoft.azure:azure-storage:jar:7.0.1:compile
   ```
   
   There are duplicate azure-storage entries in hadoop-project/pom.xml of hadoop-2.10.0. 
   https://github.com/apache/hadoop/blob/rel/release-2.10.0/hadoop-project/pom.xml#L1126-L1130
   https://github.com/apache/hadoop/blob/rel/release-2.10.0/hadoop-project/pom.xml#L1187-L1191
   
   My guess is that dependency conversion of maven-dependency-plugin is affected by this. The duplicate was removed by https://github.com/apache/hadoop/commit/0d4f9c778967ce0f83663c63389987335d47c3ea.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org