You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Akshat Bordia (Jira)" <ji...@apache.org> on 2021/10/16 14:51:00 UTC
[jira] [Created] (YARN-10978)
yarn.nodemanager.aux-services.%s.classpath configuration fails to reflect
on Windows Path
Akshat Bordia created YARN-10978:
------------------------------------
Summary: yarn.nodemanager.aux-services.%s.classpath configuration fails to reflect on Windows Path
Key: YARN-10978
URL: https://issues.apache.org/jira/browse/YARN-10978
Project: Hadoop YARN
Issue Type: Bug
Reporter: Akshat Bordia
Steps to Reproduce:
1. Add auxillary service configuration such as spark_shuffle.
2. Add following configuration to provide custom classpath for the auxillary service:
yarn.nodemanager.aux-services.spark_shuffle.classpath=D:\Spark\yarn\*
3. Start NM
Expected Behavior:
1. NM should start along with the auxillary service.
Actual Behavior:
1. NM keeps crashing due to auxillary service not being able to start as it is not able to find required classes.
java.lang.ClassNotFoundException: org.apache.spark.network.yarn.YarnShuffleService
Potential Fix:
Using File.separator instead of "\" to make glob expansion OS agnostic.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org