[GitHub] [spark] gengliangwang edited a comment on pull request #34085: [SPARK-36835][BUILD] Enable createDependencyReducedPom for Maven shaded plugin

[GitBox <gi...@apache.org>]

gengliangwang edited a comment on pull request #34085:
URL: https://github.com/apache/spark/pull/34085#issuecomment-926746395


   @sunchao @JoshRosen I find that after merging this PR, Spark can't build with Hadoop2.7. The build hangs for over 1 hour
   ```
   $ ./build/mvn clean package -DskipTests -B -Pmesos -Pyarn -Pkubernetes -Psparkr -Pscala-2.12 -Phadoop-2.7 -Phive -Phive-thriftserver
   
   ...
   [WARNING] spark-launcher_2.12-3.2.0.jar, unused-1.0.0.jar define 1 overlapping resource:
   [WARNING]   - META-INF/MANIFEST.MF
   [WARNING] maven-shade-plugin has detected that some class files are
   [WARNING] present in two or more JARs. When this happens, only one
   [WARNING] single version of the class is copied to the uber jar.
   [WARNING] Usually this is not harmful and you can skip these warnings,
   [WARNING] otherwise try to manually exclude artifacts based on
   [WARNING] mvn dependency:tree -Ddetail=true and the above output.
   [WARNING] See http://maven.apache.org/plugins/maven-shade-plugin/
   [INFO] Replacing original artifact with shaded artifact.
   [INFO] Replacing /opt/spark-rm/output/spark-3.2.0-bin-hadoop2.7/launcher/target/spark-launcher_2.12-3.2.0.jar with /opt/spark-rm/output/spark-3.2.0-bin-hadoop2.7/launcher/target/spark-launcher_2.12-3.2.0-shaded.jar
   [INFO] Dependency-reduced POM written at: /opt/spark-rm/output/spark-3.2.0-bin-hadoop2.7/launcher/dependency-reduced-pom.xml
   ```
   
   Could you help fix it?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org