You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/06/18 12:22:10 UTC
[GitHub] [spark] LuciferYang commented on pull request #36890: [SPARK-39491][YARN] Hadoop 2.7 build fails due to org.apache.hadoop.yarn.api.records.NodeState.DECOMMISSIONING
LuciferYang commented on PR #36890:
URL: https://github.com/apache/spark/pull/36890#issuecomment-1159455357
@HyukjinKwon I test manually as follows:
```
mvn clean install -DskipTests -pl resource-managers/yarn -am -Pyarn -Phadoop-2
```
```
[INFO] Compiling 25 Scala sources to /basedir/spark/resource-managers/yarn/target/scala-2.12/classes ...
[ERROR] [Error] /basedir/spark/resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala:454: value DECOMMISSIONING is not a member of object org.apache.hadoop.yarn.api.records.NodeState
[ERROR] one error found
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Spark Project Parent POM 3.4.0-SNAPSHOT:
[INFO]
[INFO] Spark Project Parent POM ........................... SUCCESS [ 3.637 s]
[INFO] Spark Project Tags ................................. SUCCESS [ 10.738 s]
[INFO] Spark Project Local DB ............................. SUCCESS [ 5.492 s]
[INFO] Spark Project Networking ........................... SUCCESS [ 8.388 s]
[INFO] Spark Project Shuffle Streaming Service ............ SUCCESS [ 5.692 s]
[INFO] Spark Project Unsafe ............................... SUCCESS [ 7.937 s]
[INFO] Spark Project Launcher ............................. SUCCESS [ 4.376 s]
[INFO] Spark Project Core ................................. SUCCESS [02:56 min]
[INFO] Spark Project YARN Shuffle Service ................. SUCCESS [ 24.754 s]
[INFO] Spark Project YARN ................................. FAILURE [ 12.485 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 04:20 min
[INFO] Finished at: 2022-06-18T20:18:16+08:00
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal net.alchim31.maven:scala-maven-plugin:4.3.0:compile (scala-compile-first) on project spark-yarn_2.12: Execution scala-compile-first of goal net.alchim31.maven:scala-maven-plugin:4.3.0:compile failed.: CompileFailed -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <args> -rf :spark-yarn_2.12
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org