You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by Vishva Avu <av...@gmail.com> on 2019/05/14 11:43:16 UTC

Fwd: Issue in docs page : single cluster yarn setup - https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node

Hi,

Step 1 for
https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node

Configure parameters as follows:

etc/hadoop/mapred-site.xml:

<configuration>
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
</configuration>

<configuration>
    <property>
        <name>mapreduce.application.classpath</name>
        <value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
    </property>
</configuration>

but setting this will throw an error when running yarn :

2019-05-14 16:32:05,815 ERROR org.apache.hadoop.conf.Configuration: error
parsing conf mapred-site.xml
com.ctc.wstx.exc.WstxParsingException: Illegal to have multiple roots
(start tag in epilog?).

This should be modified to
<configuration>
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
    <property>
        <name>mapreduce.application.classpath</name>
        <value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
    </property>
</configuration>

and also what is the function of second property here ?

I could not find the issues page where I can log this, so mailing it here

Regards,
Vishva

Re: Issue in docs page : single cluster yarn setup - https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node

Posted by Vinod Kumar Vavilapalli <vi...@apache.org>.
Good catch.

Please file a JIRA ticket here: https://issues.apache.org/jira/browse/YARN <https://issues.apache.org/jira/browse/YARN>. Please put a patch up too if you can!

The second property is a configuration for MR jobs to figure out where the MapReduce framework libraries are.

Thanks
+Vinod

> On May 14, 2019, at 4:43 AM, Vishva Avu <av...@gmail.com> wrote:
> 
> Hi,
> 
> Step 1 for
> https://hadoop.apache.org/docs/r3.2.0/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node
> 
> Configure parameters as follows:
> 
> etc/hadoop/mapred-site.xml:
> 
> <configuration>
>    <property>
>        <name>mapreduce.framework.name</name>
>        <value>yarn</value>
>    </property>
> </configuration>
> 
> <configuration>
>    <property>
>        <name>mapreduce.application.classpath</name>
>        <value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
>    </property>
> </configuration>
> 
> but setting this will throw an error when running yarn :
> 
> 2019-05-14 16:32:05,815 ERROR org.apache.hadoop.conf.Configuration: error
> parsing conf mapred-site.xml
> com.ctc.wstx.exc.WstxParsingException: Illegal to have multiple roots
> (start tag in epilog?).
> 
> This should be modified to
> <configuration>
>    <property>
>        <name>mapreduce.framework.name</name>
>        <value>yarn</value>
>    </property>
>    <property>
>        <name>mapreduce.application.classpath</name>
>        <value>$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*</value>
>    </property>
> </configuration>
> 
> and also what is the function of second property here ?
> 
> I could not find the issues page where I can log this, so mailing it here
> 
> Regards,
> Vishva