You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Gautham Banasandra (Jira)" <ji...@apache.org> on 2022/12/06 11:07:00 UTC

[jira] [Assigned] (YARN-10978) yarn.nodemanager.aux-services.%s.classpath configuration fails to reflect on Windows Path

     [ https://issues.apache.org/jira/browse/YARN-10978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gautham Banasandra reassigned YARN-10978:
-----------------------------------------

    Assignee: Akshat Bordia  (was: Gautham Banasandra)

> yarn.nodemanager.aux-services.%s.classpath configuration fails to reflect on Windows Path
> -----------------------------------------------------------------------------------------
>
>                 Key: YARN-10978
>                 URL: https://issues.apache.org/jira/browse/YARN-10978
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Akshat Bordia
>            Assignee: Akshat Bordia
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Steps to Reproduce:
> 1. Add auxillary service configuration such as spark_shuffle.
> 2. Add following configuration to provide custom classpath for the auxillary service:
> yarn.nodemanager.aux-services.spark_shuffle.classpath=D:\Spark\yarn\*
> 3. Start NM
> Expected Behavior:
> 1. NM should start along with the auxillary service.
> Actual Behavior:
> 1. NM keeps crashing due to auxillary service not being able to start as it is not able to find required classes.
> java.lang.ClassNotFoundException: org.apache.spark.network.yarn.YarnShuffleService
> Potential Fix:
> Using File.separator instead of "\" to make glob expansion OS agnostic.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org