You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Vishva Avu <av...@gmail.com> on 2019/05/14 11:43:16 UTC
Fwd: Issue in docs page : single cluster yarn setup - https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node
Hi,
Step 1 for
https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node
Configure parameters as follows:
etc/hadoop/mapred-site.xml:
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
</configuration>
<configuration>
<property>
<name>mapreduce.application.classpath</name>
<value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
</property>
</configuration>
but setting this will throw an error when running yarn :
2019-05-14 16:32:05,815 ERROR org.apache.hadoop.conf.Configuration: error
parsing conf mapred-site.xml
com.ctc.wstx.exc.WstxParsingException: Illegal to have multiple roots
(start tag in epilog?).
This should be modified to
<configuration>
<property>
<name>mapreduce.framework.name</name>
<value>yarn</value>
</property>
<property>
<name>mapreduce.application.classpath</name>
<value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
</property>
</configuration>
and also what is the function of second property here ?
I could not find the issues page where I can log this, so mailing it here
Regards,
Vishva
Re: Issue in docs page : single cluster yarn setup -
https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node
Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
Good catch.
Please file a JIRA ticket here: https://issues.apache.org/jira/browse/YARN <https://issues.apache.org/jira/browse/YARN>. Please put a patch up too if you can!
The second property is a configuration for MR jobs to figure out where the MapReduce framework libraries are.
Thanks
+Vinod
> On May 14, 2019, at 4:43 AM, Vishva Avu <av...@gmail.com> wrote:
>
> Hi,
>
> Step 1 for
> https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node
>
> Configure parameters as follows:
>
> etc/hadoop/mapred-site.xml:
>
> <configuration>
> <property>
> <name>mapreduce.framework.name</name>
> <value>yarn</value>
> </property>
> </configuration>
>
> <configuration>
> <property>
> <name>mapreduce.application.classpath</name>
> <value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
> </property>
> </configuration>
>
> but setting this will throw an error when running yarn :
>
> 2019-05-14 16:32:05,815 ERROR org.apache.hadoop.conf.Configuration: error
> parsing conf mapred-site.xml
> com.ctc.wstx.exc.WstxParsingException: Illegal to have multiple roots
> (start tag in epilog?).
>
> This should be modified to
> <configuration>
> <property>
> <name>mapreduce.framework.name</name>
> <value>yarn</value>
> </property>
> <property>
> <name>mapreduce.application.classpath</name>
> <value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
> </property>
> </configuration>
>
> and also what is the function of second property here ?
>
> I could not find the issues page where I can log this, so mailing it here
>
> Regards,
> Vishva