You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@myriad.apache.org by "DarinJ (JIRA)" <ji...@apache.org> on 2016/05/02 21:33:12 UTC
[jira] [Commented] (MYRIAD-176) YARN_HOME value ignored in "
$YARN_HOME/bin/yarn nodemanager"
[ https://issues.apache.org/jira/browse/MYRIAD-176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15267339#comment-15267339 ]
DarinJ commented on MYRIAD-176:
-------------------------------
This isn't really a bug, it's an artifact of the fact we echo the command before actually running it. It might be we can remove the echo at this point, or replace $ with \$ in the echo line.
> YARN_HOME value ignored in " $YARN_HOME/bin/yarn nodemanager"
> -------------------------------------------------------------
>
> Key: MYRIAD-176
> URL: https://issues.apache.org/jira/browse/MYRIAD-176
> Project: Myriad
> Issue Type: Bug
> Components: Scheduler
> Reporter: Zhongyue Luo
>
> Below is the stdout log from one of my node managers.
> sudo tar -zxpf hadoop-2.5.0-cdh5.3.1.tar.gz && sudo chown yarn . && cp conf hadoop-2.5.0-cdh5.3.1/etc/hadoop/yarn-site.xml; export YARN_HOME=hadoop-2.5.0-cdh5.3.1; sudo -E -u yarn -H env JAVA_HOME=/usr/java/default YARN_HOME=hadoop-2.5.0-cdh5.3.1 YARN_NODEMANAGER_OPTS=-Dyarn.nodemanager.container-executor.class=org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor -Dnodemanager.resource.cpu-vcores=4 -Dnodemanager.resource.memory-mb=4096 -Dmyriad.yarn.nodemanager.address=0.0.0.0:31873 -Dmyriad.yarn.nodemanager.localizer.address=0.0.0.0:31142 -Dmyriad.yarn.nodemanager.webapp.address=0.0.0.0:31765 -Dmyriad.mapreduce.shuffle.port=31515 /bin/yarn nodemanager
> at the end of the line, you can see that it is "31515 /bin/yarn nodemanager" where there are two spaces between '31515' and '/bin'.
> This seems to happen due to the java code not recognizing the $YARN_HOME value in
> https://github.com/apache/incubator-myriad/blob/master/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java#L65
> causing an additional blank space in front of '/bin'. However all nodemanagers seem to run just fine despite the attempt to execute yarn on /bin. I've tested this with vanilla hadoop 2.5.0 and 2.7.0 and CDH 5.3.1 all cases showing same symptoms.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)