You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-dev@hadoop.apache.org by "Akshat Bordia (Jira)" <ji...@apache.org> on 2021/10/16 14:51:00 UTC

[jira] [Created] (YARN-10978) yarn.nodemanager.aux-services.%s.classpath configuration fails to reflect on Windows Path

Akshat Bordia created YARN-10978:
------------------------------------

             Summary: yarn.nodemanager.aux-services.%s.classpath configuration fails to reflect on Windows Path
                 Key: YARN-10978
                 URL: https://issues.apache.org/jira/browse/YARN-10978
             Project: Hadoop YARN
          Issue Type: Bug
            Reporter: Akshat Bordia


Steps to Reproduce:
1. Add auxillary service configuration such as spark_shuffle.
2. Add following configuration to provide custom classpath for the auxillary service:
yarn.nodemanager.aux-services.spark_shuffle.classpath=D:\Spark\yarn\*
3. Start NM

Expected Behavior:
1. NM should start along with the auxillary service.

Actual Behavior:
1. NM keeps crashing due to auxillary service not being able to start as it is not able to find required classes.
java.lang.ClassNotFoundException: org.apache.spark.network.yarn.YarnShuffleService

Potential Fix:
Using File.separator instead of "\" to make glob expansion OS agnostic.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org